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Abstract 


In the past few years, the Mixed H 2 /ftoo -Control Problem has been the object of 
much research interest, since it allows the incorporation of robust stability into the 
LQG-framework. The general Mixed Ti 2 /'H (X1 -Design Problem has yet to be solved an- 
alytically. Numerous schemes have considered upper bounds for the 7^2 performance 
criterion and/or imposed restrictive constraints on the class of systems under investi- 
gation. Furthermore, many modern control applications rely on dynamic models ob- 
tained from finite-element analysis and thus involve high-order plant models. Hence 
the capability to design low-order (fixed-order) controllers is of great importance. In 
this research a new design method was developed, that optimizes the exact %2-norm 
of a certain subsystem subject to robust stability in terms of 7 "foo~constraints and a 
minimal number of system assumptions. The derived algorithm is based on a differ- 
entiable scalar time-domain penalty function to represent the 7 f oo-con strain ts in the 
overall optimization. The scheme is capable of handling multiple plant conditions 
and hence multiple performance criteria and Tfoo-constraints, and incorporates addi- 
tional constraints such as fixed-order and/or fixed structure controllers. The defined 
penalty function is applicable to any constraint that is expressible in form of a real 
symmetric matrix-inequality. 
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GLOSSARY 


Basic Notation: 

j : Square root of — 1 . 

k\ : Factorial of a positive integer k. 

z r , z t : Real and imaginary part of a complex number 2. 

I 2 | : Absolute value of a (complex) number 2. 

(= : Element of a set, e.g., x 6 L-2- 

~ : Equivalence definition, i.e. the state— space realization 

of a linear system G := (A, B, C, D). 

1 — ■> : Mapping from one space to another, e.g. the mapping of 

La-signals w{s) € R ,lw to signals z(s) G R llz defined by 
the transfer function G{s) of a linear system, 

6 ’(.s) : w(s) t— ► z(s). 


Vector and Matrix Notation: 


dim(x) 

£{x) 

I 

vec(M) 

diag(M) 

T race(M) 
\M\ 

M t 

M~ l 


: Dimension of a vector x. 

: Expected value of x. 

: Identity matrix. 

: Vector representation of a matrix M (see appendix A). 
: Diagonal matrix with the main diagonal of M and 
zero entries everywhere else. 

: Trace operator. 

: Determinant of a square matrix M. 

: Transpose of M . 

: Inverse of M . 



M+ 

e M 

M > 0 (M > 0) 
n(M) 

Af{M) 

A,(M), A (M) 
a,(M), <x( M ) 


: Generalized Moore Penrose inverse of a matrix M . 

: Matrix exponential. 

: The symmetric matrix M is positive definite (semidefinite). 
: Range space of the matrix M . 

: Null space of the matrix M. 

: k th and maximal eigenvalue of Af, respectively. 

: k th and maximum singular value of M , respectively. 


Gradient-Related Notation: 


df(K,dK) 
dM{KJI<) 
*1 AL 

Sx ’ SK 


: Variation of a scalar cost function /( K) due to a 
matrix variation dK (see appendix A). 

: Matrix equivalent of df(K,dK) for a matrix-valued 
function of a matrix K (see appendix A). 

: Gradient of a function with respect to a scalar or 
vector x and matrix I< respectively. 


Norm-Related Notation: 

|| x || 2 : The La-norm of a (continuous-time) vector signal x(t ): 

11*11! = io°° x T {t)x(t)dt. 

l 2 : Space of (continuous-time) vector-valued signals with 



finite La-norm (square integrable). 

IIMIIf 

: Froebenius norm of a (real) matrix: 


\\M\\f = [Trace(M M T )]i . 

GO") 

: G(s) | s =jw 

IK'IU 

: The Tii norm of a transfer function G( s). 

IIGIU 

: The "Hco-norm of a transfer function G{$) 


IX 



Some Specific Notation Adopted in this Work: 

A\ B[ , C' k , 0). l : State-space matrices of the i th plant condition 

with k , l = 1,2, 3. 

ARI 1 cof (C 0 ,X\Y) : Algebraic Riccati Inequality representing the 

i th "Hoo-constraint in the general continuous-time 
output-feedback multi-plant case (see chapter 5). 

ARI c ,sf(C Q,X,- y) : Algebraic Riccati Inequality representing the 

Hoo-constraint in the continuous-time full 
state-feedback single-plant case (see chapter 6). 

ARI d ,sf(Co,X, 7) : Algebraic Riccati Inequality (Linear Matrix Inequality) 

( LM I d ,sf(C 0, X, 7)) representing the / H 00 -constraint in the discrete-time full 

state-feedback single-plant case (see appendix D). 


Acronyms: 
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Algebraic Riccati Equation. 

ARI 

Algebraic Riccati Inequality. 

DGKF 

Doyle, Glover, Khargonekar and Francis. 

LMI 

Linear Matrix Inequality. 

LQ 

Linear Quadratic. 

LQR 

Linear Quadratic Regulator. 

LQG 

Linear Quadratic Gaussian. 

MIMO 

Multi Input/Multi Output. 

RMS 

Root-Mean-Square. 

SISO 

: Single Input/Single Output. 
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Chapter 1 

INTRODUCTION 


1.1 Why Mixed H 2 /'Hoo-Control: Motivation 

Control theorists have developed a formidable framework for the analysis and design 
of control systems for linear time-invariant (LTI) systems. One of the remaining 
problems, however, is that of uncertain and disturbed systems. Mathematical mod- 
eling of a physical system provides the basis for the design of feedback controllers. 
In order to obtain a simple model of the dynamic process, compromises have to be 
made between the fidelity of the system model and the complexity of its model de- 
scription. This process invariably implies modeling errors and hence uncertainties 
in the model description. Such uncertainties can include neglected high— frequency 
dynamics, variables that might change during the course of operation, or parameters 
that are just unknown but bounded within a certain domain. Additionally, in many 
cases measurements and actuator signals will be noise corrupted. All of these uncer- 
tainties have to be taken into account when designing a controller. 

In many modern engineering applications the use of lightweight materials has be- 
come a necessity to conserve energy, fuel or other resources. This is true especially 
in fields such as aeronautics and astronautics or robotics. Modeling of such plants 
typically relies on finite element techniques and hence involves high-order plant mod- 
els. In order to arrive at a practically implementable controller, the chosen design 
method must be able to provide the capability to design fixed-order controllers (that 
is, controllers with a prespecified low order regardless of the plant-order). Due to 
physical limitations many applications also require the design of structurally con- 
strained controllers. Furthermore, few plants will have the same system model over 
the whole range of operation. To avoid techniques such as gain-scheduling or adaptive 
control schemes, it is desirable to design a single controller that takes into account 
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various operating conditions. In short, a successful controller design paradigm must 
take into account model uncertainties and disturbances and be able to accommodate 
requirements such as fixed-order /fixed-structure controllers. 

At this point we have to clearly differentiate between two design objectives in the 
control— law synthesis. First and foremost the controller must provide robust stability. 
That is, the closed loop system must be asymptotically stable for all considered 
uncertainties and disturbances. Once the closed-loop stability has been satisfied, we 
may require that additional performance specifications are met as well. Ideally one 
would like to design a controller that provides acceptable performance (in some sense) 
and guarantees stability for all uncertainties. However, this most general problem of 
Robust Performance with Robust Stability is theoretically hard to tackle, even for 
very simple performance measures, and is a matter of ongoing research. Instead, the 
problem considered in this work is the problem of Nominal Performance with Robust 
Stability. That is, the performance measure is optimized for the nominal plant while 
stability is guaranteed for a set of bounded uncertainties. Using recent results on 
robust performance, this design scheme will be related to the general problem of 
Robust Performance with Robust Stability. In this introduction we will make frequent 
use of system and signal norms such as My , M x , and L 2 • These norms are defined 
in chapter 2. The reader unfamiliar with these norm concepts is urged to consult 
chapter 2. 

H 2 ~ theory has a long history. The first step in this development was the for- 
mulation of quadratic performance indices for deterministic systems. The Linear 
Quadratic Regulator (LQR) design philosophy was the outcome of this research effort. 
This framework then was extended to include noise corrupted systems where mea- 
surement and system noises were modeled as white— noise processes. This approach 
extended the concept of LQ-performance to systems with noise corruption and re- 
sulted in the Linear Quadratic Gaussian (LQG) framework. This design method can 
in turn be formulated in terms of an ^-optimal control problem. Stochastic dis- 
turbances with distributions other than white noise are easily incorporated into this 
framework by the use of shaping filters. Thus, for LQ-type performance problems 
in noise corrupted systems with stochastic disturbances of known distribution, Hi- 
optimal control is the tool of choice. Despite their nice interpretation in terms of 
stochastic disturbance rejection and LQ performance, H 2 -optimal controllers have 
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one important drawback. The plant model is assumed to be known exactly! For this 
nominal plant W-i-optimal controllers guarantee well documented stability margins. 
If the plant is perturbed due to plant parameter uncertainties, however, 7f 2 -optimal 
controllers may no longer guarantee closed-loop stability. This philosophy is, in its 
very essence, a performance— oriented design framework that was not intended to solve 
the stability problem inherent to uncertain systems. Future research may develop a 
scheme in which the proper choice of weighting matrices in the quadratic cost function 
may provide a tool to define robust stability even for this method. Research, however, 
has not progressed to this point yet. The ^ norm of linear time-invariant systems is 
not applicable to the robust stability problem in a small gain framework because the 
7d 2 -norm of transfer functions is not submultiplicative and has no interpretation as a 
transfer function gain. In short, H- 2 provides an excellent framework for performance 
considerations and white-noise disturbance rejection as developed in the LQR and 
LQG design philosophies. In a more realistic concept, however, mathematical models 
are necessarily uncertain and the resulting stability problem is not solvable with this 
approach alone. 

Starting with the early works of Hurwitz, Schur and Lure, stability theory for 
linear time-invariant systems has progressed to modern robust stability approaches 
such as Kharitonov-type theorems, parameter-dependent Lyapunov functions, the 
concept of stability radii of system matrices and criteria based on singular values 
such as the Bounded Real Lemma and the Small Gain Theorem. T^oo-analysis and 
synthesis are based on the Small Gain Theorem and form an effective method to 
account for norm bounded plant uncertainties for the design of controllers that guar- 
antee robust stability. The types of uncertainties that can be accommodated include 
static parametric uncertainties as well as dynamic uncertainties such as unmodeled 
high-frequency plant, actuator and sensor dynamics. The perturbations may be real, 
complex, scalar or matrix-valued and hence encompass a wide variety of practical 
design problems. However, the W,*, -framework in its present form is concerned with 
the design of linear controllers for linear plants. Hence many problems (in particu- 
lar problems involving nonlinear uncertainties) cannot be tackled with this method. 
Extensions of the 'H 00 -scheme to these kinds of problems are currently under inves- 
tigation. 
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The "Hoo-norm of a system is the maximum singular value of the transfer func- 
tion over all frequencies and can be interpreted as the maximum gain of a transfer 
function for all Li -bounded input signals, or as the maximum ratio of the Li -norm 
of the system output and the L 2 -norm of the system input (see chapter 2). The in- 
terpretation of the 'Hoo-norm as the worst— case gain and the fact that the 'hi 0 o ~ norm 
is submultiplicative make this norm an appropriate mathematical tool for a robust 
stability criterion within the framework of the Small Gain Theorem. Although the 
Small Gain Theorem provides only a sufficient criterion for robust stability, the Hoo~ 
framework has become increasingly popular in the last decade. This research effort 
is justified by the extendability of "Hoc-methods to the Upper Bound p-Problem and 
the ease of computation in contrast to other methods, //-theory gives necessary and 
sufficient conditions for robust stability. Computationally, however, this problem has 
not yet been solved. By convention the term “Woo— design problem refers to the 
design of suboptimal Hoo~ controllers. Suboptimal controllers satisfy a prespecified 
stability bound in contrast to optimal 'H 00 -controllers that actually minimize the 
robust stability measure. Woo-optimal controllers, however, are often undesirable 
due to the occurrence of high gain and large controller bandwidth. Most subopti- 
mal 7-f oo-controllers do not exhibit these disadvantages. For a large class of problems 
suboptimal TYoo controllers are easily computed via the solutions of two Ricc.ati equa- 
tions with an associated coupling condition. Unlike for H 2 , the separation principle 
is not valid in the case of Hoo- In summary, Hoo provides a suitable framework for 
the incorporation of uncertainty into a controller design concept for robust stability. 

On the other hand, possible performance considerations in this framework alone 
must necessarily be of limited scope. Let us, for the moment, considei a Multiple 
Input/Multiple Output (M1M0) system with rn inputs and rn outputs. For such a 
system, the “Hoo -norm depicts, by definition, only one point of the maximum singular 
value function (as a function of frequency) which is one out of m possible singular 
value functions. Considering the limited information that the H,oo ~ norm piovides 
about the overall internal structure of a system, a controller design approach based 
on Hoo will not be able to incorporate LQ performance measures in a way Hi does. 
Within the framework of //-theory some approaches in this direction have been for- 
mulated nonetheless. The performance measures there are only of the maximum- 
singular-value-type and must not be confused with Hi performance specifications. 



TYoo is an important tool for robust stability, but it is useful only as a robust stability 
constraint in an overall performance-oriented scheme that takes into account all the 
other design specifications that a comprehensive controller design paradigm has to 


It is obvious at this point that the combination of H 2 and Hoo into a mixed 
'Hi/'Hoo -framework incorporates the advantages of both approaches. It allows the 
formulation of performance specifications in a more realistic fashion, namely for un- 
certain systems. It eliminates the stability problems inherent to the 7 Y 2 -philosophy 
and adds the performance aspect in terms of 7 ~t 2 to the 7 Yoo~f ra mework. The re- 
sulting approach for the problem of H 2 - Performance with Hoo -Robust Stability is a 
relatively new and promising approach to combine these design specifications into 
one comprehensive design concept for a large class of real world problems. These 
advantages sparked an enormous research effort in this field in the last few years. 

Within the mixed 7T 2 /7Yoo-design methodology one has to differentiate between 
Nominal H 2 - Performance with Hoc-Robust Stability and Robust H 2 - Performance 
with Woo-Robust Stability . In the first approach the H 2 -n orm of the nominal trans- 
fer is minimized. This approach has the advantage that the ^-problem and the 
7 "f 00 -problem can be considered separately. The latter approach seeks to minimize 
the corresponding 7Y 2 -norm for the perturbed plant. This problem is still unsolved. 
By convention the expression “mixed H^fHoC^ will refer to the problem of Nominal 
H 2 - Performance with Hoo-Robust Stability . Within this methodology two different 
directions have evolved. In most cases there will be a conflict between the 7 ~t 2 - and 
the ?foo-objectives. This means that tighter robust stability bounds will lead to de- 
teriorating 7 T 2 -performance and vice versa. This problem is referred to as the mixed 
PC 2 /Hoo -design problem. The goal in this philosophy is to find a controller that min- 
imizes the 7 T 2 — norm of a given transfer function, subject to an 7 Yoo”eenstraint on 
another (possibly different) linear system. This approach is drastically different from 
the Simultaneous H 2 j Hoo -Optimal Control Problem ([91], [96]), where one seeks a 
controller that minimizes the T^-norm of a given transfer function while simultane- 
ously satisfying the desired Ti^-constraint. This type of problem will be solvable only 
for special cases. The difference between these approaches is that the simultaneous 
7 ^ 2 /^ 00 -optimal controller will always be 7 Y 2 -optimal while this may not be the case 
for the mixed ^/Woo-design approach. 
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The problem considered in this research is that of Nominal Hi -Performance with 
Hoo-ftobust Stability and can now be posed as follows. Under a minimal number of 
system assumptions, the problem is to find a controller of fixed order/fixed structure 
that minimizes the 7"f 2 norm of a given transfer function, subject to an T~too ~ bound 
on another linear system. Finally, the design concept should be easily extendable to 
the multi-plant case. 

1.2 Related Literature 

In general this problem formulation involves two subproblems. The W 2 -control prob- 
lem has been treated extensively in the last two decades and will be reviewed only 
briefly. One of the important contributions of modern 7 T 2 — research is the interpreta- 
tion and setting of 7T 2 iu the frequency-domain ([25], [111])- Most recent advances 
can be found in [18], where a generalized parametrization for 7T 2 -optimal controllers 
has been derived. In most present schemes, the order and structure of the controller 
may not be arbitrarily pre-assigned. A recent approach using homotopy methods 
can be found in [19]. One method for the gradient— based design of constrained 
controllers was developed in [64], In particular, the method developed there does 
not require an initially stabilizing controller, it allows the design of structurally con- 
strained controllers and incorporates the design capability for multiple plants. For 
further discussion of nominal related problems the reader is referred to standard 
publications such as [66]. Robust TG— design on the other hand is a matter of present 
research and some results are slowly forthcoming. As already mentioned, the general 
problem of robust 7i 2 is not solved yet. All approaches in this direction represent 
upper bounds for this robust performance; noteworthy in this respect is the work by 
Stoorvogel ([1 14], [117]). Following a different approach, so-called guaranteed UG cost 
controllers have been investigated in [39] and [83]. 

Tfoo-theory on the other hand has a rather short history. Although the Small Gain 
Theorem was introduced by Zanies in 1966 ([136]), it took another fifteen years until 
the same author applied this concept to the disturbance attenuation problem for de- 
terministic uncertainties. Zames’s 1981 seminal paper ([137]) has to be considered the 
beginning of Ti^-theory. Using the Youla (Q-) parametrization for all stabilizing con- 
trollers, it was shown that the T-f^-design problem is in general infinite-dimensional 
([12], [66]). Based on a formulation of the Hoc -problem in terms of a Hankel ap- 
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proximation problem, subsequent research derived various frequency-domain solu- 
tion methods for the one, two and general four-block problems ([23], [27], [28], [29], 
[44], [46], [132], [138]). Computationally these methods were cumbersome and did 
not attract much attention in practical applications. The celebrated 1989 paper by 
Doyle et. al. ([24], see also [43]) solved the regular suboptimal Hoc-design problem 
and presented a Two-Riccati Hoo-Solution (also termed the DClKF-equations). Fur- 
thermore, in this paper it was shown that a suboptimal Hoc - controller — if such a 
controller exists - will be of the same order as the plant. The resulting controller 
is termed the Central Controller. For properties of the Central Controller such as 
pole-zero cancellation as well as lifting techniques for some of the imposed system 
assumptions, the reader is referred to [97] and [108]. Additional information on com- 
putational issues can be found in [32] and [33]. The ease of computation and the 
fact that this controller is of finite dimensions made this method a powerful tool. 
In [70] some properties of the Non-Central Controller are examined. Further devel- 
opment illustrated the intimate relationship between the ARE-based Hoc -approach 
and certain game-theoretical problems ([1], [2], [4], [5], [51], [73], [78], [87], [103], 
[120], [125], [126], [127], [129]). Connections between Riccati equation approaches to 
the Hoo-problem, game-theory and quadratic stabilizability have been examined by 
Petersen ( [77] , [78] , [79] , [80] , [8 1 ] , [82] , [84] ) . 

The singular Hoc-problem was solved by Stoorvogel ([113], [132], [116], [119]) in 
terms of quadratic matrix inequalities and various rank conditions. A recent extension 
of this approach to the reduced-order case can be found in [118]. Although compu- 
tationally not as attractive as the method in [24], this approach removed some very 
restrictive system assumptions imposed in [24]. One of the remaining assumptions 
was a rather restrictive constraint on the system zeros. Removal of this assump- 
tion requires either the use of perturbation techniques ([97]) or a reformulation of 
the problem in terms of Algebraic Riccati Inequalities (ARI’s) ([48], [98], [99]). The 
significance of matrix inequalities in systems theory was recognized very early and 
has sparked renewed interest in this technique over the last few years ([15]). The 
characterization of H<x>-bounds in terms of matrix inequalities can be traced back 
to a paper by Willems ([134], see also [128]). This idea was utilized in a paper by 
Zhou and Khargonekar ([141]) and forms the basis for the most advanced Hoo _ design 
methods available at this time. A characterization of all suboptimal Hoo-controllers 



8 


has been developed by Gahinet ([35], [36], [37]) as well as by Iwasaki and Skelton 
([52], [53]). This method requires the solution of two convex matrix inequalities sub- 
ject to a rank inequality. This framework has to be considered more general than 
ARE-based methods as it does not require observability or controllability of the con- 
sidered plant, only detectability and stabilizability are needed. These assumptions 
are required for the existence of a stabilizing controller and hence do not represent a 
loss of generality. Parallel to this work Geromel et. al. and Peres developed a similar 
technique that resulted in a convex parametrization of all full state-feedback subopti- 
mal ^-controllers ([38], [40], [41], [76]). Theoretically these results give a complete 
characterization of all full state— feedback and reduced— order output— feedback T~Lx>~ 
controllers. The computation of solutions for matrix inequalities, however, remains 
still a matter of current research ([14], [15], [100], [103]). The number of publications 
related to the robust stability problem is extensive. The above citations represent 
only the most important recent papers. For a comprehensive list of publications in 
the last few years the reader is referred to [21]. 

A very general framework for the mixed 7"G/^foo-design problem has been devel- 
oped by Ridgely ([89]) as well as Steinbuch and Bosgra ([112]). The approach utilizes 
a set of Lagrange multipliers to append the 7"foo-constraint in terms of an ARE to 
the TG-performanc.e cost. Corresponding gradients give necessary conditions for the 
derivation of a mixed TG/7"fo< ‘Controller. Gradient— based methods are used to com- 
pute the controller. The approach incorporates many important features such as 
fixed-order /fixed-structure controllers. However, in addition to a set of rather re- 
strictive system assumptions, this approach requires an initially stabilizing controller 
that satisfies the desired 'H-qq— bound. Also, due to the 7"Go _ characterization by an 
ARE, this problem formulation requires the corresponding ^. problem to be regular 
( non-singular , [24]). 

A special class of systems has been considered by Bernstein and Haddad. For 
these systems the same outputs for the 7"G and Woo— criteria, but diffeient distur- 
bance input channels are assumed. For these systems a scheme has been developed 
by Bernstein and Haddad ([6], [7], [8]). In this approach an upper bound for the 
corresponding Hi-no rm is minimized while the specified ^Go-constraint is satisfied. 
The computation of fixed-order controllers in this scheme involves the solution of 
up to six coupled Riccati equations. Only homotopy methods are available to solve 
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such a computationally challenging task ([9]). The dual problem has been solved in 
[26] and [140]. Subsequently it has been shown in [135] that the conditions derived 
in [ 6 ] and [26] are necessary and sufficient. For the case of full state-feedback, the 
above idea can be formulated as a convex optimization problem using the controller 
parametrization introduced in [38] and a constraint in form of a convex matrix in- 
equality. This particular problem has been investigated by Rotea, Khargonekar and 
coworkers ([56], [58], [91], [93], [94]). 

Yet another approach to mixed Hz/Hoo-design J s based on the 7 -Entropy of a 
system ([ 68 ], [69], [71]). This function is finite only if the Hoq — constraint is satisfied. 
In this case the negative function value represents an upper bound for the 7 -f 2 -norm 
of this system. Unfortunately this formulation is applicable only if the ^-objective 
and the 'W 00 -constraint are related to the same transfer function. 

1.3 Outline of the Report 

This introduction is followed by preliminary definitions and results in chapter 2. 
There relevant norms are defined, uncertain systems and their representation as well 
as the Small Gain Theorem and various types of 7"foo~bound characterizations are 
presented. In chapter 3 the actual problem definition is stated along with system 
assumptions and state-space representations of the considered plants. Chapter 4 
provides an introduction to matrix inequalities and their relevance in control sys- 
tems theory. A new differentiable scalar cost function is defined that represents the 
corresponding "Hoc-constraint in the overall optimization scheme. Some properties 
and possible applications of this cost function are discussed. A new approach to the 
multi-plant Hoo-ctesigri problem based on this new cost function is then formulated 
in chapter 5. The related optimization can be performed either as a constrained opti- 
mization or via a penalty /barrier function approach. A discussion of these algorithms 
and some numerical advice are included in this chapter. An extension of this scheme 
naturally leads to the formulation of the multi-plant H 2 /Hoo-design problem in terms 
of the defined scalar cost function. This design problem is considered in chapter 6 . 
The state-feedback single-plant case with an upper bound for the corresponding Hz- 
cost and identical disturbance inputs for the H 2 and Tfoo-criteria as treated in [58] 
can be found in this chapter as well. This chapter is followed by concluding remarks 
in chapter 7 and some comments on possible extensions of the presented scheme as 
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well as an outline of potential future research directions in chapter 8. In appendix 
A auxiliary matrix results that are required for various proofs are presented along 
with the theoretical framework necessary for the computation of gradients for all the 
cost functions that are defined throughout this report. Explicit gradient expressions 
for the relevant cost functions can be found in appendix B. In appendices C and D 
it is shown that the scalar cost function can also be used for 'H 00 -constrained opti- 
mization problems where the performance measures are not Hi- In appendix 0 the 
Minimum Gain F 3 roblcm subject to an l~loo ~ constraint for the full state feedback case 
in the continuous time domain is examined. Appendix D shows the applicability 
of the presented scheme to Tf ^-problems in the discrete-time domain. As an Hoo~ 
constraint in the discrete-time domain can be represented via an ARI, the proposed 
cost function can also be used to impose the T^-constraint. The objective is the 
nominal L,-norm of the closed-loop A matrix which has interpretations in terms of 
time— domain constraints on the state and the control vectors. 

Except for the results presented in appendix D, the formulation and treatment of 
the TYoo-design problem and the mixed H 2 /^oo-problem are cast completely in the 
continuous-time domain. An exception to this rule was made only to demonstrate 
the applicability of this scheme to discrete-time problems. 

In appendix E the accompanying MATLAB Hoc- design software based on the 
results in chapter 5 is described in details. Usage of the software is illustrated by ex- 
amples and possible causes for noil-convergence of the algorithm are also discussed. 
Although the same algorithm has been utilized for the mixed 'H 2 /W 00 -design exam- 
ples, the mixed Hij Hoo -design software still requires the adjustment of parameters 
in intermediate steps of the algorithm. Hence, for this reason it is not included in 
this appendix. Note that in the appendix E a different notation has been adopted 
for the description of the open-loop systems. The notation follows closely the stan- 
dard notation used in the literature for the pure Woo— problem and it differs from the 
notation used in the body of this report. 

The following notational convention is used throughout this report. In general 
signal dependency on time will be shown explicitly while a possible frequency de- 
pendency is omitted. The context will identify whether the time-domain or the 
frequency-domain is considered. Furthermore, for linear time-invariant systems the 
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term “asymptotic stability” refers to stability over an infinite time-horizon and hence 
exponential stability of the system under consideration ([16]). Similarly, a matrix M 
is asymptotically stable if the real parts of every eigenvalue of M is negative, ('di- 
versely, a matrix M is “antistable” if — M is asymptotically stable. The term “mode” 
is equivalent to an eigenvalue of a matrix. Also, a linear time-invariant system is 
minimal if it is both observable and controllable. For brevity the term transfei 
function” is generally used to refer to transfer function matrices in the case of multi- 
input/multi-output systems. The remaining abbreviations can be found either in the 
glossary or are defined in the body of this report and are fairly standard. 

1.4 Contributions 

1. A new scalar time-domain cost function is defined that allows the representation 
of 'Hoo-constraints in terms of a scalar constraint. The defined cost function is 
continuous and differentiable. Explicit gradient expressions are provided and 
hence standard nonlinear gradient— based software may be applied to solve the 
suboptimal multi-plant ft^-design problem. An iterative scheme is presented 
to numerically solve the associated optimization problem. Furthermore the 
possible extension to a multi-plant "Hoo-optimal controller design method is 
outlined. The considered plants need not be of the same order and for each plant 
a different set of input/output vectors may be defined that will be subject to 
the 'Hoc -constraints. The developed scheme includes features such as multiple 
plants, multiple ^-constraints, full state-feedback, strictly proper and proper 
controllers with fixed-order and/or structure. The initial controller guess is not 
required to be stabilizing. Furthermore the system assumptions are the least 
restrictive. 

2. Based on the proposed cost function and hence the scalar representation of 
7d x constraints a new approach for the multi-plant problem of Nominal Til- 
Performance with Robust Stability is formulated. For multiple plants the 
n 2 -criterion is a weighted sum of the individual K 2 -norms of each plant condi- 
tion. Due to the differentiability of the T^-criterion the numerical treatment is 
equivalent to that of the pure Tfoo-design problem including the same features 
and capabilities as described above. 
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3. The scheme is applicable to problems where other performance criteria are 
desired and to Hoo-constrained problems in the discrete-time domain. The 
Minimum Gain Problem subject to an Pioo constraint for the state— feedback 
case in the continuous-time domain and the 7-foo-c.onstrained control problem 
with time-domain constraints in the discrete-time domain have been shown to 
be solvable with the presented approach. 

4. The proposed cost function is applicable to enforce any kind of matrix constraint 
in the form of a scalar inequality constraint as long as the matrix constraint 
under consideration is expressible in terms of a real symmetric differentiable 
matrix inequality. This property allows the application of the developed scheme 
to many other constrained optimization problems. In particular it is shown 
that the proposed cost function is convex if the underlying matrix inequality is 
convex and hence convexity of the original constraint is preserved. 



Chapter 2 

PRELIMINARIES 


2.1 Norm Definitions 

In the following G := ( A,B,C,D ) will denote the state-space realization of a LTI 
system G with w(t) as input and z(t ) as output. 

c { i(t) = Ax(t) + Bw{t), x(0) = x 0 ^ 2 .i) 

7 [ z(t) = Cx(t) + Dw(t) 

The corresponding transfer function from w(s ) to 2 r(.s) in the frequency-domain is 
denoted by G(s) = C(sl - A)~ x B + D for x 0 = 0. One can define a multitude 
of norms for LTI systems. Among these, the H 2 and -norms have become 
the most widely used system norms due to their nice mathematical properties and 
intuitive interpretations. Note that the l~t 2 — norm is defined only for strictly proper 
asymptotically stable systems, the 7i 2 -norm of proper or unstable systems is infinite. 

Definition 2.1.1 

Consider a strictly proper asymptotically stable LTI system G := (A, O', 0) with 

corresponding transfer function G(s), then the TL 2 -norm ||G ||-2 is defined as follows. 


1 . 


1 1 C 1 1 2 - 

y Trace( j°° Ce Al BB T e ATt C T dt.) 

(2.2) 

= 

JTrace{ j°° B T e ATt C T Ce Al Bdt ) 

(2.3) 

2. Let w be. white noise signals 

with unit power spectral density S ww (ju>) 

= /, then 


Trace[— f G(ju>)G T (—juj)du] 
1 Z7T J—oc 

(2.4) 

ii 

CM 

5 
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= lim y/£[z T (tf)z(t f )]. 

tf— *oo v 


(2.5) 

( 2 . 6 ) 


The characterization of ||G ’||2 in terms of (2.2) and (2.3) gives rise to the familiar 
computation of this norm in terms of the controllability or observability grammians. 
Equations (2.4), (2.5) and (2.6) illustrate the interpretation of the %-norm in the 
frequency-domain in terms of stochastic white— noise signals as driving inputs. For 
this type of disturbance input, the 7T 2 -norm is an appropriate measure for the energy 
(RMS value) of the output. In particular (2.6) shows that ||Gr Y || 2 can be computed 
via a finite— time cost function yjS\z r {tj')z{t}')\ in the limit as tj — > oo. In a practical 
implementation one need not go to the actual limit tj — > oo. Depending on the 
eigenvalues of the system, a large but finite tj would adequately approximate the 
true H 2 norm of the system. This fact, has been utilized for a very general design 
algorithm in [64]. 

The 7 _ f 00 -norm, on the other hand, is a gain norm. As with the 7T 2 norm, there 
are interpretations in the time and frequency domains. 


Definition 2.1.2 

Consider an asymptotically stable LTI system G := (A, B, C, D) with the correspond- 
ing transfer function G(s ) and Xq = 0, then the 7ioo~ norm IK'lloo ls defined as follows. 


\\G\\ 


sup 

w, IMl2=i 


lim 


rh 

Jo 


N Jo 


W 1 


( t)z(t)dt 
( t)w(t)dt 


sup 

W, 1 1 1^| 1 2 — ^ 



sup \f\[G T {-ju)G(ju)] 


sup cr[G(ju>)\, 


(2.7) 

( 2 . 8 ) 

(2.9) 

( 2 . 10 ) 


where A(.) and a{.) are the maximum eigenvalue and maximum singular value of the 
arguments respectively. 


Physically this norm is the worst-case ratio of output energy to input energy for input 
signals with bounded energy. Very interesting in this respect is the fact that periodic 
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signals have unbounded energy and hence are not included in the above time-domain 
definition. That is, the supremum in equations (2.7) and (2.8) will not be achieved 
for the considered class of disturbance signals u>(t) £ L 2 . In general we have 

f li z T (t)z(t)dt < || Gil [ tj iv T {t,)w{t)dt x 0 = 0, Vu»(i) £ L 2 , Vtf > 0. (2.11) 

Jo Jo 

Reference [26] contains a more in-depth discussion along these lines. The frequency- 
domain definition shows that this norm is the worst-case gain over all frequencies. 
The class L 2 of disturbance signals for which the Hoo-norm is defined, makes the 
combination of H 2 and H^ so attractive. General L 2 -disturbanc.es do not have nice 
interpretations in the 7Y 2 framework, stochastic noise signals on the other hand have 
no relevance in Hoo-theory. In addition to the usual properties of operator norms, 
the 'Hqo - norm ' s submultiplicative. That is, 

||67/||oo < 116’IU ||//||oo (2.12) 

for two transfer functions G(. s) and //(.s). Operator norms that satisfy this inequality 
are also called generalized operator norms. The above inequality does not hold in 
general for the H 2 -norm. Submultiplic.ativity is the key feature of the Hoo -norm that 
allows its application to the robust stability problem via the Small Gain Theorem. 

2.2 Equivalent Representations of H ,*, -Constraints for LTI Systems 

Even though there is no analytical “one-step” solution for the most general H 2 -design 
problem, efficient solutions for this design strategy with structurally constrained and 
fixed— order controllers have been developed ([64]). The true problem associated with 
the general H 2 /Hoo-design task is that of the Hoo-constraints. All present Hoc-design 
approaches and analysis methods are, in one way or another, based on the representa- 
tion of an Hoo-constraint in terms of the eigenvalues of a certain Hamiltonian matrix 
or matrix constraints such as LMI’s ARE’s or ARI’s. The characterization of an 
Hoo -constraint in terms of a matrix inequality such as an ARI or a LMI is the central 
tool for the design method in this work. In this section some of the close connec- 
tions between these different Hoc-representations as well as properties of ARI’s and 
solutions to ARI’s are reviewed. 
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Lemma 2.2.1 (Frequency Domain) 

Consider an asymptotically stable system G := {A, B,C, D), then ||6r||oo <7 */ an( 1 
only if 

7 2 1 - G T (-juj)G(joj) > 0. (2.13) 


This lemma follows directly from the frequency-domain definition of the 'H 00 -norm 
and needs no further proof. It simply states that all singular values (as a function of 
the frequency u>) are smaller than 7 for all ui. This lemma is very intuitive and shows, 
along with the frequency-domain definition of the norm, that the hioo — norm of 
a system is a basic system property that does not depend on a particular state-space 
representation of G(s) or properties such as controllability or observability. The 
following lemma illustrates the connection between the time— domain definition of the 
Tfoc-norm and its frequency-domain counterpart. For further reference the following 
abbreviations are introduced: R = ( 7 2 7 — D T D), S = (7 2 1 — DD T ). It is easily 
verified, that R and S satisfy the following relations. 

R~ } D r = D 7 *- 1 and 

I + DR-'D t = 7 2 S~\ 

Hence in the following equations, R and S are interchangeable using these identities. 

Lemma 2.2.2 (A/ 7 , [11]) 

Consider a system G := ( A , B,C, D) with A asymptotically stable, then ||G'||oo <7 */ 
and only if M., has no purely imaginary eigenvalue where 

M — ( A + BR~ x D t C .BR-'B? \ 

^ ^ - 7 C7 t .S , - 1 C ~[A+ BR~ X D T C] T ) 

The relation between lemma 2.2.1 and lemma 2.2.2 is easily established by the 
fact that M-y is the system matrix of the state-space representation for [ 7 2 / - 
G T (— ju>)G(jto)]~ l ■ It can be shown that 7 2 / — G T (—joj)G(ju)) has a spectral fac- 
torization 7 2 7 - G T (—ju>)G(ju>) = H T {-ju)H{ju) if and only if A / 7 has no purely 
imaginary eigenvalue jlo. Thus 7 2 / — G T (—ju))G(jui) > 0 is satisfied if and only 
if ( ju>I — M-y) is non-singular for all ju, which in turn is equivalent to ||G’||oo < 7 - 
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Hence the computation of the 'Woo -norm of a system is reduced to a 7 -iteration and a 
corresponding eigenvalue computation (see [11]). So far, however, no design method 
is based directly on this property of The following lemma illustrates the connec- 
tion between the time-domain definition of the Hoo-norm and its frequency-domain 
counterpart. 

Lemma 2*2.3 (LQ-Cost, ARE, [125]) 

Consider an asymptotically stable system G (A, B,C, D ) with ( A , B) controllable. 


((7, A) observable and 7 > cr(D), then || 6 r||oo <7 if and only if 

r 00 < 

sup / [z T (t.)z(t) — -y 2 iv T (t.)iv(t)}dt = sup Joo(w) < oo. (2.15) 

W&L2 do w€.L/2 

If the above supremum is finite then the worst-ease disturbance wq ( t.) is given by 

Wo (t) = R~'{D T C + B T Y]x{t ), ■ (2.16) 

where Y — Y ! > 0 is the unique symmetric positive-definite solution to 

ARE(Y) = 0, (2.17) 

ARE(Y) := [A + BR-'D t C] t Y + Y[A + BR~'D t C] 

+YBR~ 1 B t Y + 7 2 C t S _1 C (2.18) 

such that A -f B R~ X (D T C + B T Y) is asymptotically stable and 

max Joo(iy) = x T 0 Yx 0 . (2.19) 

U)CiIj2 


It comes as no surprise that the Hamiltonian matrix associated with this two-point 
boundary problem is related to My as defined above via a similarity transformation. 
Hence the Riccati equation (2.17) will have a finite symmetric positive-definite solu- 
tion Y if and only if the maximization problem has a finite solution. Such a solution 
exists if and only if My has no ju>-eigenvalues which in turn is equivalent to the above 
Tfoo-bound being satisfied. In general there is a number of matrices Y that satisfy 
ARE(Y) = 0 but only one positive-definite matrix Y that satisfies ARE(Y) = 0 
such that A + B R~ 1 (D T C + B T Y ) is asymptotically stable. This matrix V separates 
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the spectrum of M 7 into a stable and anti-stable part represented by the eigenval- 
ues of A + BR-'(D t C + B T Y) and -[A + BRr'(D T C + B T Y)] T respectively. This 
lemma forms the basis for all ARE— based methods to 'H 0 o~ : synthesis. In particular 
the DGKF solution to the 7"foo -problem is based on this lemma. Equivalent game 
theoretical approaches (see e.g. [125], [126], [127]) utilize the characterization of an 
Tfoo-bound in terms of the above LQ-problem for various control feedback strategies. 
The obvious relation between the time— domain definition of the Woo— norm and lemma 
2.2.3 can be established via a linear fractional optimization problem. The reader is 
referred to chapter 6 in [20] for more information on this issue. Lemma 2.2.3 is based 
on variational optimization ideas and invariably invokes the basic assumptions of 
controllability and observability. 

Note at this point that the “if-and-only-if” relationship between ||G||oo < 7 an d 
the existence of a Y such that ARE(Y ) = 0 with A + BR~ 1 (D T C + B T Y ) asymp- 
totically stable is not dependent on its derivation from a variational problem. The 
considered maximization problem is only a tool to derive this equivalence. Further- 
more, if the above controllability condition (or, alternatively observability of (G, A)) 
is not satisfied, then the corresponding ARE-solution Y can in general be positive 
semi-definite (see e.g. [17], [43]). 

The next lemma provides a very general necessary and sufficient criterion for 
IK-Iloo < 7 in terms of an ARI. 

Lemma 2.2.4 (ARI, [141]) 

Consider an asymptotically stable system G := (A, B,C, D) and 7 > cr{D), then 
IK'lloo < 7 if and only if there exists a symmetric positive-definite X\ such that 

ARI]{X\) < 0 , ( 2 . 20 ) 

ARIi(Xi) := [A+ BR~ 1 D t C] t X 1 + X x [A + BRT 1 D t C] 

+Xi BR - 1 B t X , + 7 2 G t .S-Y7. (2.21 ) 

This lemma can be derived directly from equation (2.13) and forms the basis for most 
recent Tfoo-design methods. An explicit proof can be found in [7] or [141], Note that 
the definition of ARR{X 1 ) in (2.21) implies that ARh(Xi) is a square matrix and 
hence the eigenvalues of ARI- i (X- i ) are well defined. In the following discussion we will 
frequently use this fact. In general it is harder to find a solution to a matrix inequality 
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than a solution to a Riccati equation. Thereis no “one-step” method available to find 
solutions for such inequalities. On the other hand, this lemma provides a very general 
means to determine whether an Hoo-hound is satisfied or not. In particular, lemma 
2.2.4 does not assume any system properties other than stability. Also, there is not 
one unique solution to such an inequality. Rather, there is a whole set of possible 
solutions. It is important to note at this point that this inequality characterization 
can be viewed as finding a matrix such that ARI\{X\) is negative-definite or in 
terms of the eigenvalues of the ARI\(X i), that is ARI^(X^) is asymptotically stable. 
As the matrix ARI\ ( X\ ) is a real symmetric matrix, negative definiteness is equivalent 
to stability of ARI\(X i). Hence any matrix inequality (or matrix constraint) of the 
form 

T[ARI x {X x )}T t < 0, |71^0, or (2.22) 

T[ARh(X x )]T^ < 0, TT t = /, or (2.23) 

T[ ARI\{X a ) ]T -1 asymptotically stable , \T\ / 0 (2.24) 

is equivalent to the AR1 criterion in lemma 2.2.4. The constraint TT r = / in (2.23) is 
necessary to maintain symmetry of T[ ARI\{X\) ]T _1 . This fact as well as the Sc.hur 
complement form of block-structured matrices give rise to some equivalent matrix 
inequality formulations as presented in the following lemma. They do not form new 
criteria but rather provide different forms of AR1\{X\). 

Lemma 2.2.5 

Consider an asymptotically stable system G := (A,£?,(7, D) with 7 > then the 

following statements are equivalent: 

1 . 

Halloo < 7- (2.25) 

2. There is a system representation G := ( A, B,C, D) such that 

ARI 2 {T) < 0, (2.26) 

ARI 2 {T) := [A + BRT'D T CPi r + [A + BR-'D T C] 

+BR~'B t + 7 i C T S~ y C, 


(2.27) 
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where A — TAT 1 , B = TB , C = CT 1 and D = D for some non-singular 
transformation matrix T . Furthermore , T can be taken to be upper triangular. 


3. There is a real symmetric positive semi-definite Z\ such that 


LM 1\{Z\) 


A T Z, +Z, A + C T C Z X B + C T D 
B t Z x +D t C — (q 2 / — D T D) 


4 . There is a real symmetric positive semi-definite Z 2 such that 


( a t z 2 + z 2 a + c T c z 2 b c t 

LMlfiZi) := B T Z 2 - 7 / D T 

1 C D - 7 / 


< 0 . 


(2.29) 


Proof: The equivalence of statements 1 and 2 is a variation of theorem 1 in [112]. 
Obviously, if (2.25) is true, then there is a symmetric positive-definite solution X\ to 
ARfi(Xi) < 0 in (2.20). Now let T be the (non-singular) Cholesky factor of X 1 such 
that X] = T t T, where T is an upper triangular matrix. Now, AR1\{X\) < 0 if and 
only if (T T )~ X ARI\(X\)T~ X < 0 for any non-singular matrix T. Multiplying (2.21) 
with (T r ) _1 from the left side and with T~ x from the right side yields the desired re- 
sult, namely equivalence of equations (2.20) and (2.26). Equivalence of statements 1, 
3 and 4 is easily shown via repeated application of the Schur complement formula (see 
Appendix A) for block-structured matrices and is a standard result ([36], [37], [53]). ■ 

Equation (2.26) shows that a desired Tfoo-bound can be tested via a search over 
all nonsingular transformation matrices T, or, alternatively over all possible system 
realizations of G(s). In general the above inequality characterizations of an 'H x> - 
bound will give rise to different numerical schemes to enforce a desired Tfoo-bound. 
Hence they are important for the numerical treatment of the corresponding Tioo- 
bound problem in the mixed 'H 2 /'Woo-desig n - The inequality formulation in equation 
(2.28) has the advantage of being linear in Z\ and q 2 . The characterization (2.29) 
is linear in Z 2 and 7 . For that reason (2.28) and (2.29) are also referred to as Lin- 
ear Matrix Inequalities (LMI). However, they are linear in all involved parameters 
only if the system matrices are assumed to be constant and independent of possible 
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other variables. When designing an Woo-controller based on the closed-loop re- 
bound characterization in terms of the above LMI’s, the matrices A,B y C and D in 
(2.28) and (2.29) will be functions of the controller. Unfortunately, in the general 
output-feedback case this dependency of A , fi, C and D on the controller parameters 
will destroy linearity of the above matrix inequality, and ultimately the convexity 
of the corresponding optimization problem as will be seen later. Further criteria for 
IK'lloo < 7 are the Rounded Real Lemma in various forms ([128]) as well as a criterion 
based on the concept of entropy ([71]). They are not directly relevant to the results 
in this work and hence are omitted here. 

Now let us turn to some properties of possible solutions X\ for ARI\(X\) < 0. 
These properties will prove valuable for the numerical implementation of the 7ioo~ 
and mixed 7i-2 /'H 0 o -design algorithms. To this point let us assume that a particular 
matrix X\ = (Xf) T > 0 does indeed satisfy ARI\(X*) < 0. Then there exists a 
symmetric positive-definite matrix Q such that 

[a + br-'d t c] t x; + x;[A + br-'d t c] + x;br~'b t x; + 1 2 c T s~ l c + Q = o, 

( 2 . 30 ) 

where R = (7 2 1 — D 1 D) and S = (7 2 1 — DD T ) as defined previously. Alternatively 
one can write (2.30) as follows. 

a t x* + x;a + [x;b + c t d)r~ x [x;b + c t d] t + c T c + q = o. (2.31 ) 

If Xf > 0, (Vj*) -1 is well defined. Now, by use of the above identities on R and .9, 
yet another form of (2.30) can be derived. 

(x;)- 1 [a + bd t s~'c} t + [a + bd t s~'c]{x ;) _1 

+ 7 2 (X 1 *) _1 C T .9 _1 C(A r 1 *) _1 + BR- l B T + Q = 0, (2.32) 

where Q = (Xj") -1 Q(X|) -1 * These equations form the basis for the proof of the 
following theorem. 
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Theorem 2.2.1 

Given a system G := (A, B,C, D) with 7 > a(D ) and ||fj||oo < 7 an d a symmetric 
positive-definite matrix X f = (Xj ) T > 0 suc/z that ARI\( AJ 1 ) < 0, then the following 
statements are true. 

1. The system matrix A is asymptotically stable. 

2. A aux = A + BR~ X D T C - A + BD T S~ X G is asymptotically stable. 

3. Y < X\, where Y solves ARE(Y) = 0 in lemma 2.2.3. 
f. L 0 < Xj, where L 0 solves 

A T L 0 + LoA + C T C = 0. (2.33) 


5 . L 0 < where L 0 solves 

A T L + L 0 Aaux + 1 2 C T S-'C - 0 . 


(2.34) 


6. L c < (X,*) 1 , where L c solves 


L c A T aux -\- A aux L c + B R 1 B — 0. 


(2.35) 


Proof: ARJ\{Xl) < 0 implies the existence of Q > 0 and Q > 0 in equations (2.30), 
(2.31) and (2.32) respectively. Now, with 

\x*b + c t d]r~' [x;b + c T d] t + c T e + q> o, 

the pair (A , [X{B + G T D]R~ l [X;B + C T D] T + G T C + Q) is observable and hence 
a standard Lyapunov argument applied to equation (2.31) shows that A must be an 
asymptotically stable matrix. This proves statement 1. Assertion 2 is shown in the 
same way by considering equations (2.30) or (2.32) respectively. A proof for statement 
3 can be found in [85] and is omitted here. Statement 4 can be proved by subtracting 
equation (2.33) from equation (2.31) to yield 

a t [x;-l 0 ) + [x;-l 0 }a + [x*iB + c t d}r-'[x;b + c t d} t + q = o . 
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With A asymptotically stable, it follows directly from Lyapunov’s theorem that 
x; - L 0 > 0 and hence statement 4. Statements 5 and 6 can be proved in the 
same way by use of the ARE’s (2.40) and (2.32) and the Lyapunov equations (2.34) 
and (2.35) respectively. ■ 

Assume for the moment that the matrices A, B,C and D represent a closed-loop 
system G c i(s) with a certain controller (7(s) in place. Then, if a matrix Xf has been 
found such that ARI\{X^) < 0, two results follow immediately: 

1 . IK'dlloo < 7 by lemma 2.2.4, and 

2. G c i := (A, B,C, B) is an asymptotically stable system by theorem 2.2.1. 

Hence, an Tioo or mixed T^/^oo-design paradigm based on the ARI-charac.terization 
of the corresponding TCo-constraint of the closed-loop system need not enforce sta- 
bility explicitly. Closed-loop stability will naturally follow once a controller C(s) and 
a matrix Xf have been found such that ARI\(X*) < 0. The other results in theorem 
2.2.1 will be valuable for various aspects in the numerical formulation of the proposed 
algorithm for the mixed -design. Note however, that in contrast to lemma 

2.2.3 stability of A + BR“ l (D T C + B T X*) cannot be concluded ( and is not necessary 
any more) from X* satisfying ARI \(X*) < 0. This is due to the fact that theorem 
2.2.1 is not based on an optimization problem. The properties of X^ in theorem 2.2.1 
are based on the frequency-domain inequality (2.13), the equivalent ARI representa- 
tion in (2.30) and the Lyapunov theorem. No optimal control concepts as in lemma 
2.2.3 have been utilized. 

To further illustrate the properties stated in theorem 2.2.1, an example plant is 
considered. The system matrices are as follows. 

\ 



( -1.004 

-5.438 

0 

0.438 ^ 


( 1 

-0.004 

-5.438 


-0.004 

-3.438 

0 

0.438 

, B = 

1 

-0.004 

-5.438 

A = 






-10.876 


-0.008 

-10.876 

-4.000 

0.876 


1 

-0.008 


v -0.218 

7.743 

0 

-4.894 j 


1 ° 

-0.218 

7.743 


1 

1 

1 0 

\ 

D = | 

/ 0 

0 

0 

C = | 


] , 





l -0.004 

-5.438 

0 0.438 

i 


l o 

-0.004 

-5.438 
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This plant is asymptotically stable and the corresponding Tioo-norm of the system 
G := (A, B,C, D) is ||G’||oo = 5.4378. Choosing 7 = 5.7000 > ||(7||oo, one particular 
solution Xf = (A' 1 *) T satisfying ARIi(X^) < 0 is 

( 1.113 -1.047 2.422 

_ -1.047 7.348 -1.494 

1 ~ 2.422 -1.494 39.327 

v 3.575 -1.880 56.791 

The eigenvalues of X* are 0.2869, 0.8215, 7.4424 and 122.1650 and hence Xf > 0. 
The corresponding eigenvalues of ARI\(Xj) are —0.1373, —1.0137, —1.6807 and 
— 781.1729, implying that the ARI-inequality constraint ARI\(X^) < 0 is satisfied. 
It can furthermore be verified that all conditions in theorem 2.2.1 are satisfied as 
well. However, the eigenvalues of A + BR~ l (D T C + B T X{) are 0.0417 ± 1.2607j 
and 0.0217 ± 0.0732j, respectively. Hence the matrix A + B R~ l (D T C + B T Xf) is 
completely antistable. That is, all eigenvalues of A + BR~ l (D T C + B T X*) are un- 
stable. This fact represents a departure from the ARE-characterization as in lemma 
2.2.3, where the solution Y of ARE(Y) = 0 needs to satisfy the additional constraint 
that A + BR~^(D 7 C + B T Y ) be asymptotically stable. This is not necessary for the 
ARI-characterization, as exemplified above. 

Let us expand further on this property. Assume an asymptotically stable system 
G ( A , £?, ( 7 , D) with Hf/Hoo < 7. Then, by lemma 2.2.3 there is a symmetric pos- 

itive semi-definite matrix Y 0 (or positive definite Y 0 , depending on the observability 
and controllability of the pairs (A, B) and (C, A) respectively) satisfying 

[A + BR ~ x D t C] t Y 0 + Y 0 [A + BRT 1 D T C] + Y 0 BR~ x B t Y 0 + -f' 2 C T S~ x C = 0 (2.37) 

such that A + B R~ x [D T C + B T Y 0 ) is asymptotically stable. Now consider possible 
solutions to the ARE 

[A + BR- X D T C\ T {Y 0 + dY(s)) + (Y 0 + dY{e))\A + BR~ x D t C] 

(Y 0 + dY(e))BR~ x B t {Y 0 + dY(e)) + ^C T S~ X C + el = 0 (2.38) 




for some small positive e. From (2.37) and (2.38) it follows directly that dY(e) 
satisfies 

[A + BR _1 ( D t C + B T Y 0 )] T dY {£ ) + dY{e)\A + BR~\D t C + B T Y 0 )\ + e/ = 0 (2.39) 

where the quadratic terms in dV^e) are neglected. From this Lyapunov equation one 
can conclude that, with A + BR~ l (D T C + B T Y 0 ) asymptotically stable, dY{e) = 
[dY(e)] T > 0 is continuous in e. Thus the eigenvalues of A + BR~^[D T C + B T (Y Q + 
dY(e))] are continuous in e as well. Hence one can choose e such that A+B R~ X [D T C+ 
B T (Y 0 +dY(e))] remains stable. However, dY(e) > 0 implies (Uo + dV^s)) > 0. Hence 
there exists a symmetric X\ = (Y 0 4- dY(e)) > 0 such that ARI\(X{) < 0 and A + 
BR-'(D t C+B t X°) is asymptotically stable. Although the above example has shown 
that in general there may be matrices Xf that satisfy the inequality ARI\(Xf) < 
0 without this additional stability requirement, the above derivation shows that, 

whenever the 'H 00 -bonnd is satisfied, there will also exist a symmetric, positive- 

definite solution to the ARI that also satisfies the additional stability constraint as 
imposed for the ARE solution. These observations are summarized in the following 
corollary. 

Corollary 2.2.1 

Assume an asymptotically stable system G ~ (A, £?,(7, D) with ||(7||oo < 7. Then the 
two following statements are true. 

1. There exists a X* = (X 1 *) T > 0 such that ARI\(Xf) < 0. 

2. There exists a X[ = [X^) T > 0 such that ARI\(X°) < 0 
and A + BR~ l (D T C + B T X%) is asymptotically stable. 


So far only strict 7Yoo-bounds have been considered in this discussion, i.e., only 
the case H^Hoo <7. As a final point in this section let us consider the case where 
7 = II Cr || oo and its implications for possible solutions to the above ARI’s. In the 
following, assume that A is asymptotically stable and that the necessary condition 
7 > cr(D) for HG’lloo < 7 is satisfied. In this case the strict inequality (2.13) has 
to be replaced by q 2 / — G T (—juj)G(ju>) > 0. Under these circumstances the proof 
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for lemma 2.2.4 in [7] is still applicable and it immediately follows that ARI\(X{) 
will be negative semi-definite for some X^. However, many of the above conclu- 
sions about positive definiteness of or stability of A as in theorem 2 . 2.1 may no 
longer be true if ARI\(X*) < 0 . To illustrate these problems, consider equations 
(2.30) and (2.31), but now for a Q that is positive semi-definite. If X * > 0 and 
ARh(X 7) < 0 then A is asymptotically stable. However, Xf need not be positive 
definite in this case. Depending on various observability/controllability conditions, 
Xf may be positive semi-definite or, by similar considerations on (2.32), infinite in 
some modes. In general, at 7 = || CV||oo most of the nice properties of ARE’s and ARI’s 
break down and many important implications become inconclusive. In a numerical 
implementation this case can be circumvented by forming an “e-perturbed” ARI of 
the form ARI\{X\)+el < 0 which effectively enforces the strict inequality ||(7||oo < 7» 


2.3 Uncertain Systems: Stability and Performance 

At this point let us consider the problem of robustly stabilizing an uncertain sys- 
tem before adding performance considerations to this scheme. This problem is most 
generally represented in Figure 2.1. 

E perv?p (.s) is the open-loop perturbed or uncertain plant model for which a linear 
stabilizing controller (7(,s) has to be designed. Uncertainties in the plant description 
may arise from a variety of sources. These can be neglected dynamics, parametric un- 
certainties such as component tolerances, model parameter uncertainties or variables 
that change over the course of operation as well as neglected nonlinearities. Except 
for some static nonlinearities such as saturated actuators, general nonlinearities can- 
not be handled with the current Hoo-theory. A comprehensive description of these 
issues can be found in [13]. Mathematically these uncertainties may be represented 
either in the state-space form as uncertain entries in the respective system matrices, 
or in the frequency-domain as input and output multiplicative system perturbations 
Aj(.s) and Ao(-s) respectively, or as additive system uncertainties A a (.s) as follows. 

S p er,op( ,< ') = S nom ^ op (.s) [/ T Ai(.$)] 

Sper,op(*s) = \I T Ao(s)]E nomi 0 p (s) 

^per,op(«s) — ^nom,op(^) T A a (.s). 


(2.40) 

(2.41) 

(2.42) 
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Figure 2.1: Stabilization of an uncertain model. 

S n0 m,op(^) represents the nominal linear open loop model. Without any performance 
objectives, the goal at this point is to find a controller that stabilizes the plant 
Sper.opCs) f° r permissible perturbations A,(s), Ao(.s) or A„(s). This amounts to 
stability robustness with respect to uncertainties in the input or output path or to 
additive uncertainties. TGo-theory requires the uncertainty to be represented in a 
form that is termed “perturbation feedback form” or ‘‘7T>, standard form”. This 
representation assumes that all uncertainties are lumped into one uncertainty block 
A s (.s) that is connected to the nominal plant in a feedback loop as shown in Figure 
2 . 2 . 

This representation is very general and forms the basis for the application of the 
Small Gain Theorem to the analysis and synthesis problem in an Tfoo-setting as well as 
for the definition of internal stability according to Desoer and Chen and Nyquist-like 
stability criteria. General frequency-domain uncertainties such as A ,-(/?), A 0 (.s) and 
A„(.s) are easily converted to this form. If one starts with a state-space description 
of the uncertain open-loop system with parametric uncertainties, this conversion will 
not always be possible. One way to design robustly stabilizing controllers for this case 
can be found in [79] and references therein. However, posing the robust stabilization 
problem in the W,*, -standard form has the advantage that it is extendable to necessary 
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Figure 2.2: Uncertainty representation in "Woo-standard form. 

and sufficient conditions for robust stability, namely /r-theory. If the state-space 
matrices of the open-loop system are linear in the uncertain parameters, such a 
feedback configuration is always possible. This is not necessarily true for the case of 
multiple uncertainties. Engineering practice has shown that this type of uncertainty 
description is applicable to a wide range of problems, however. In the following it 
is assumed that a system representation of the uncertain plant in the Woo-standard 
form exists. Woo-theory in its present form requires that A s (.s) be stable. A first 
attempt to include unstable uncertainties A s (.s) into a singular value based robust 
stability framework can be found in [54], but the presented theory has to be considered 
incomplete at this point. Furthermore, the W x , methodology assumes no internal 
knowledge of the uncertainty block A s (.s). Structured A s (.s) cannot be incorporated 
into the pure W (X) -design philosophy. An extension of Woo-theory, namely /^-analysis 
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and design, has to be applied to this type of problem. This subject, however, is 
not part of the considered research objectives. Henceforth it is explicitly assumed 
that A s (.s) is a stable transfer function for which no internal structural knowledge 
is assumed. Let us assume that a controller has been designed and connected to 
the open-loop system A s (.s) to form the closed-loop system S nom>c /(s). The question 
arises, whether the overall system, including the uncertainty block A s (s), is stable. 
This question is most elegantly answered by the Small Gain Theorem. 



Figure 2.3: Stability and small gain. 


Consider an interconnection of these systems as in Figure 2.3 with some auxiliary 
inputs uq(.s) and Wi(s). This system is internally stable if and only if the four 
transfer functions from to e.j(s), i,j = 1,2 are asymptotically stable. For 

this situation the Small Gain Theorem states the following. Assuming that A s (.s) 
is an asymptotically stable system with a TCo-norm bound i.e. ||A s (s)|| 0O < 1 
and £ boto , c /(.s) is asymptotically stable with Koo-norm bound 7, then the closed- 
loop system in Figure 2.3 is stable. The proof is most easily performed utilizing the 
submultiplicativity property of the 7Yoo-norm. It can be verified that 
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Hence from the norm-bound assumptions on the individual transfer functions and 
|| A 5 E n0m>c /|| oo < || ||oo || S nom ^ c / ||oo < 1 it follows directly that the closed-loop gain 
is bounded and hence the transfer function from w 2 (s) to e 2 (.s) is stable. A similar 
argument establishes stability for the other transfer functions. The synthesis problem 
can now be stated as follows. Assuming a set of uncertainties that are lumped into an 
asymptotically stable, 7^ -norm bounded system A s (.s) with ||A J (.s )|| 00 < find a 
controller (7(.s) that stabilizes the nominal plant S nom>op ( t s) and, in addition satisfies 
|| ^noin f cl || oo < 7 . This is a nice characterization of robust stability in terms of the 
Woo-uorm. Although there are other criteria to determine whether or not a system 
is robustly stable, most of these methods have to be considered analysis tools rather 
than design tools at present. 

So far no exogenous input signals have been included into the system description. 
As mentioned above, external signals may come from a variety of sources. Some 
signals may be disturbances (deterministic and stochastic) as well as commanded 
inputs or tracking signals. Fictitious stochastic signals have a long history in the LQG 
methodology and have proven to be a good means to model sensor and process noises. 
Although the exact distribution of stochastic disturbances is rarely known precisely, 
experience and in-depth analysis of the plant environment will in many practical 
engineering applications permit a close approximation of the noise interference in 
terms of stochastic signals with known distribution. With appropriate filters these 
signals can usually be generated from white-noise signals with unit spectral density. 
These shaping filters are easily incorporated into the open-loop plant model and 
hence we may consider white-noise signals as the only type of stochastic disturbances 
entering the plant. In Figure 2.4 zn 2 (.s) collects all stochastic inputs to the plant. That 
is, w 2 (.s) includes sensor and process noises as well as other stochastic disturbances 
and is assumed to contain only white-noise signals with unit spectral density. 

Deterministic inputs and other deterministic L 2 -bounded disturbances are repre- 
sented by the vector w Py00 in Figure 2.4. As before, it is assumed that all the system 
uncertainties are lumped into the transfer function A 5 (.s). From previous considera- 
tions it is clear that robust stability can be defined in terms of a W^-constraint on 
the transfer function from tn 5 j 00 (.s) to z SyOQ (s). Possible weighting functions on this 
transfer function are assumed to be incorporated into the open-loop model. 
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Figure 2.4: Performance with robust stability. 


Now let us turn to possible performance objectives in the overall design concept. 
For this purpose let us define two sets of criterion output vectors z Pt00 (s) and z 2 (,s). 
For future reference let T 2 (s ) , T St00 (.s ) , T Pt<x (s) and T^s) denote the transfer func- 
tions from w- 2 (s) to 2 2 (.s), from w Si00 (. s) to 2 Si00 (.s), from w Pi00 (s) to 2 p ,oo(s) and from 
W’oo^) - (wj t00 (s), (s)) T to Zoo(fl) = (zJ,oo( s )i z J,oo( s )) T respectively. 

In general there is a large number of possible performance specifications that one 
may want to impose on one or more of the above transfer functions. “Performance” 
in this context corresponds to any additional requirements on the closed-loop system 
other than robust stability. Rise and settling times, desirable closed-loop pole loca- 
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tions, controller gain limitations and so forth are only a few examples. The reader is 
referred to [13] and references therein for a comprehensive treatment of such perfor- 
mance objectives in an overall design philosophy. Performance in this research refers 
to 7-f 2 -performance, although Tioo-type performance can also be incorporated. 

^-objectives have a long history and have proven to be a good tool for practical 
control design tasks. By varying the corresponding weighting matrices Q and R in 
a corresponding LQ-cost function, many performance objectives can be addressed 
implicitly with this type of performance criterion. Assume that ic PiQO (.s) and 2 Pi00 (.s) 
are zero and concentrate on the transfer function T 2 (.s) . In this research performance 
is then defined in terms of the T^-norm of Ti(s) . The elements of z 2 (s) can corre- 
spond to a desired quadratic cost function as in the LQ-framework. More generally, 
we intend to minimize the effects of the stochastic disturbance signals to 2 (.s) onto the 
criterion vector 2 2 (.s). Robust and nominal performance are easily illustrated with the 
configuration in Figure 2.4. If we can guarantee that the controller minimizes || 2 f° r 
all permissible A s (.s), then robust ^-performance has been achieved. As mentioned 
earlier, this problem is still unsolved. Alternatively, one can define the problem of 
^-performance for the nominal plant. That is, minimize || T 2 1 | 2 for A s (.s) = 0, sub- 
ject to robust stability in terms of an Woo -constraint on T Si00 (. s) . For the stability 
problem ic 2 (.s) does not have to be considered and can be assumed to be zero. This 
problem has the advantage that the corresponding W 2 -problem and the Woo~problem 
can be treated separately. This problem has been solved in the most general setting 
with the least number of system assumptions in this research. In this formulation the 
“cross transfer functions” from te 2 (.s) to 2 s ,oo(*s) and from w Si<X) (s) to £ 2 (s) respectively 
are neglected. This fact will be discussed in section 3.5 where the results of this work 
are interpreted in terms of an upper bound for robust W 2 -performance (see [117]). 

Now let us turn to a possible performance objective for the transfer function 
T p , oo(*s). For deterministic signals iv PiOQ (s) the W 2 -norm has no performance in- 
terpretation. For this pair of disturbance/criterion vectors the Woo“Dorm offers a 
possible framework to define “performance”. That is, performance may be identified 
as the worst-case gain of T p>00 (.s) over all frequency and hence in terms of HT^ooHoq. 
Minimizing this norm (or bounding it from above) will reduce the worst-case effect of 
tu Pl oo(-s) onto z p ,oo($) according to equation (2.43). This type of performance is easily 
transformed into a stability robustness problem by introducing a fictitious uncertainty 



block A p (,$) as depicted in Figure 2.4. The overall “stability” problem can be solved 
via a single 7~foo“design defined on the transfer function Too (5) corresponding to an 
overall uncertainty block A(.s). This approach results in “robust 7 ^ 00 -performance” 
as the Woo-bounds are guaranteed for all uncertainties in A p (.s) and A 5 (.s). 

This property is utilized in //-synthesis to design controllers that provide ro- 
bust stability and robust performance. However, as mentioned before, this type of 
performance must not be confused with ^“Performance. ^-objectives are not 
included in //-synthesis as this type of performance cannot be transformed into a 
singular-value based stability problem. As in the case of 7T 2 , one can define nomi- 
nal Koo-performance by solving two ^^-problems with the same controller, one for 
robust stability (with A s (.s) representing model uncertainties), and one for the 7Tx>- 
performance defined on T Pi 00 (s) with A p (.s) as the associated uncertainty block. This 
formulation requires the capability of solving multiple 7Yoo“Constraints, & problem 
that is still hard to solve in a general formulation. 

Let us assume that a possible Tioo -performance criterion is defined via a ficti- 
tious uncertainty block A p (.s) such that the overall uncertainty A(.s) is given by 
A(.s) — ding {A 5 (.s) , A p (.s)}. Referring to Figure 2.5 we are then in a position 
to state the mixed 'H-i/'Hoo -problem (with nominal ^-performance and Tf^-robust 
stability) for the single plant case as follows. 

Mixed '^/'Hoo-design strategy: 

“Find a controller that minimizes the nominal 7T 2 -norm of T 2 (s) and robustly sta- 
bilizes the closed-loop plant for all uncertainties A(,s) subject to HAHoo < L for some 
prespecified stability radius 7 .” 


This formulation for the single plant case is easily extended to the multi-plant 
case as depicted in Figure 2.6, which treats n p open-loop plants for i = 

1 , 2, ...n p simultaneously. These plants are used to represent different operating points 
and hence multiple plant conditions or the same plants with multiple Ti? and/or 
TYoo-objectives. The 7i 2 -performance measure is a weighted sum of the individual 
transfer functions T\(s) from tu 2 (.s) to 2 . 2 (.s). Robust stability is defined in terms of n p 
TCo-constraints defined on the transfer functions T^(s) from w’ 0O (.s ) to 2 ^ 0 (.s). This 
formulation is a natural extension of the above concept for the single plant case and 
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Figure 2.5: The mixed "7^2 /^co-synthesis problem - the single plant case. 

represents a general framework for the mixed Tii/H oo-design problem. It allows the 
incorporation of multiple "Tfco-constraints for one or multiple plant models as well as 
^-performance for a range of operating conditions of the plant. In the next chapter 
these objectives will be formulated in a more mathematical fashion along with the 
corresponding state-space representation and system assumptions. 










Chapter 3 

PROBLEM FORMULATION 


3.1 State-Space Description of the Considered Systems 

According to the multi-plant mixed '^/'Hoo-fbrmulation defined in chapter 2, we con- 
sider n p linear time-invariant nominal open-loop plants £’ 2/oo , op with 7Yoo“Standard 
representations for the plant uncertainties. Without loss of generality we assume that 
each of the n p individual systems has the following realization. 
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+ 

D l 33 u l (t) 


for i = 1,2, x l (t) represents the i th system state, u l (t) is the i th control input, 

y l (t) is the measurement available to the controller from the i th system, w^t) and z^t) 
are respectively the disturbance input and criterion output for the ^-performance 
measure on the i tk plant, <o(0 ancl Z'ocit) are respectively the disturbance input 
and criterion output for which the i th >t 00 -constraint is defined. For a given plant 
condition, model uncertainties are assumed to be lumped into a stable, norm bounded 
A ! (.s)-block, 

II^WIU < i (3.2) 

with the feedback connection 

«£>(«) = A , (s)z^ 0 (s). (3.3) 


In general all of the above signals are assumed to have the following dimensions: 
x'{t) G R n *' , m’(f) G R n ^' , w^t) € fl’W , z\(t) G R n *' , 4(0 G R n ><~' , u'(t) G 
R n “' and y l G R Uy ' for i — 1,2, ...,n p . All involved matrices are of compatible dimen- 
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sions. The controller (7(.s) is assumed to have the following state-space realization 

C(9)-l ie ^ = AcXc ^ + BcV '^ (3 4 ) 

\ u'(t) = C c x c (t) + D c y l (t), 

where x c (t.) (E R 7lc and n c is a prespecified controller dimension. A compact parametric 
representation of the dynamic controller C($) is given by 


C 0 = 


D c C c \ 

B c A c ) 


( 3 . 5 ) 


For static controllers Co reduces to Co = D c . The system assumptions imposed on 
the open-loop plants are as follows. 


Assumptions: 

Al: (A\B 3 ) are stabilizable pairs for all i = 1,2, 

A 2 : (A\C 3 ) are detectable pairs for all i — 1,2 , ...,n p , 

A3: dirn(u % ) = n u i = n u and dim(y i ) = n yt = n y for all i = 1,2, ...,n p , 

A4: D\ 3 = D \ 3 = ... = D 33 = D 33 . 

Assumptions Al and A2 are necessary for the existence of a controller that stabi- 
lizes all plant conditions simultaneously. That is, a controller must be able to detect 
unstable poles through ;y*(,s) in any of the n v plants and stabilize these modes via 
the control The number of controller inputs and outputs must be the same 

for all £? 2/oo op since we consider only one controller, i.e., one control law for all plant 
conditions. This necessity is reflected in A3. Assumption A4 is a technical assump- 
tion related to a well-posed system for a class of n p plants controlled by a static 
controller. When assumption A4 is satisfied and a controller (7(.s) has been found for 
the measurement y l (s) = y*(.s) — D^ii(s)^ then the actual controller for the i th plant 
condition is 

u l (s) = u(,s), i = 1,2, Up 

«W = <?M[cy (••>) + AWM + 0j,«4W] = <?«»>), 

= C(.)|y’M - 


( 3 . 6 ) 

( 3 . 7 ) 

( 3 . 8 ) 
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Rearranging equation (3.8) yields ([113]) 

u(s) = [/ + C(s)D^-'C(s)y\s) = C(s)y'(s). (3.9) 

Thus, if the inverse of [I + (?(<$) A33] exists, the control problem is well posed and a 
controller C Y (-s) with the measurement t/*(.s) can be found from the control law realized 
by C(s) using y l (s) as measurement. Let A c , B c , C c and D c denote a state-space 
realization for (7(.s). Assuming that (/ + D C D^) is non-singular, it can be shown 
that a state-space realization for (7(.s) is as follows. 


A c 

= A e - B c D 33 (I + D c Dss)- l C c 

(3.10) 

B c 

= B C (I + D 33 D c ) 1 

(3.11) 

Cc 

= (I + D c D 33 )-'C c 

(3.12) 

D c 

= (/ + D C D 33 )-' D c . 

(3.13) 


Thus, under a mild condition and the assumption A4 the controller can be designed 
by first considering D % 3 = 0. The case D33 ^ 0 can be accounted for after the design 
for D33 = 0 has been performed. As the new controller in this case realizes the same 
control law, properties such as 7Yoo-norms and 7i 2 -norms of the closed-loop systems 
will be preserved under this operation. Hence, in the following we will explicitly as- 
sume D33 = 0. In general it is also possible to remove the direct feedthrough term D 2 2 
in the above formulation ([113]). This additional term, however, does not increase the 
complexity of formulae in this presentation. It should also be noted, that the dimen- 
sions of the individual open-loop system states x l (t) are not constrained. In general 
these dimensions can vary from one plant condition to the other. This fact allows 
the incorporation of different shaping filters or other dynamics to account for specific 
requirements of a certain plant condition. Furthermore, unlike the approach taken 
in [89], no restrictions with respect to system zeros or rank conditions are imposed 
in this formulation for the mixed ^/Woo-design. With the technical assumption A4 
the constraints A1 A4 are the minimally necessary assumptions. Hence the proposed 
formalism provides a versatile and general framework for the considered problem. 
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Now, given a controller (7 0 , the closed-loop plant conditions can be represented as 
follows. 



KM 

■ M. ^ 

II 

+ 

B cia w 'M 

+ 

B cl,oo W 'oo(t) 


Si/ooJC o) : < 


= C'ciaKM 



+ 

D 'el, oo,2<o(0 

(3.14) 


, 4 (<) 

= C 'el,ooKM) 

+ 

D da^ w W) 

+ 

Dd-oowLit)- 



Note that the direct feedthrough term D l u + D\ 3 D C D\ X from w 2 (t) to z 2 (t) is not 
shown. The ^-performance measure will be defined on the transfer functions from 
w 2 (t) to z 2 (t) and hence D x u + D\ 3 D c D* 3l = 0 is a necessary condition for the corre- 
sponding T^-norm to be finite. This constraint can be satisfied by directly constrain- 
ing the structure of the controller C'(.s) (i.e., design of a strictly proper controller if 
D l u = 0 for all i = 1,2, ...,n p ) or has to be added as constraint to the optimization 
problem to be defined. For the numerical implementation this constraint is assumed 
to be explicitly satisfied for all plant conditions by a suitable choice of the controller 
structure depending on the open loop matrices D\ 3 and D^. As discussed ear- 
lier, the approach solves the nominal 7Y 2 -problem subject to 7"foo-eonstraints. This 
implies that we can assume w^t) = 0 for the performance objective. The resulting 
closed-loop subsystems Ti 2cl (Co) from w 2 (s) to z 2 (s) with iv 1 ^ = 0 are as follows. 


SUG>) 


— + ^ci,2 W 2^) 

4{t) = 


(3.15) 


The corresponding subsystems EL ^(Co) from w'^t) to z'^t) are defined for t v 2 (t) = 
0 and are subject to the robust stability criteria in terms of '7i 0O -constraints. 


= A ii,oo x L(t) + fld >0 o«4(t) 

4 >(<) = C'^xUi) + 


(3.16) 


Obviously, in this formulation the (possibly non-zero) direct feedthrough terms D l cl ^ 2 
and O l cl 2 oo from teL(' s ) to z 2 (s) and from w 2 ( .s ) to ^^(.s), respectively, are not taken 
into consideration. This fact will be discussed in more detail in section 3.5. In general 
all the closed-loop state matrices are functions of the controller representation Co- 
This dependency is omitted here to keep the notation to a minimum. 
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For future reference the closed-loop state-space matrices of E? 2 c/ (f7o) and EJ^ c( (f7 0 ) 
are rewritten in a form that is convenient for the derivation of the explicit gradient 
expressions in appendix B. 


"4 c/,2 

= A ! 

+ 

BXC 0 C\ 

B' cW2 

= B\ 

+ 

B' 3 C 0 D^ 

L 'cl, 2 

= c\ 

+ 

D\ 3 c oQ 

^c/,oo 

= Kia 

= 

AU 


= BX 2 

+ 

B^CoDi, 

^ ' dyOO 

= C\ 

+ 

D^CoCi 

D l 

U c.l, oo 

= 

+ 

D\^CoD l y 2 


where 


( 3 . 17 ) 


A‘ = 


A 1 0 
0 0 


B\ 


B\ 

0 


BX 


BX 




B' 3 0 

0 / 


cj = ( ci o ) , a = ( a o ) , a = f ^ , 

Di 3 = ( D‘ a 0 ) , 


t> i, = ( 

, B\z 0 ) 

D i — 

i u 22 — 

dx 22 , 

A31 = j 

Di 1 \ 

0 /’ 

/V — 

.32 — 

( A 32 

l 0 


( 3 . 18 ) 


Identity matrices in this representation are assumed to be of compatible dimensions 
such that the matrix operations in (3.17) are well defined. This notation will be 
maintained throughout the remainder of this report. Note in particular, that this 
representation shows that all closed-loop matrices are linear in the considered con- 
troller parametrization Co. 
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3.2 Problem Definition 

Let T) ( C 0 , .s ) a.nd T) jO (C 0 ,s) represent the transfer functions (as a function of the 
controller parametrization C 0 ) corresponding to the closed-loop systems S? 2 ci (Co) 
and respectively. Then the mixed TTz/'Hoo-eontrol problem can be defined 

as follows. 

Definition 3.2.1 

Assume n p open-loop plant conditions as in (3.1) satisfying the assumptions A l 
through AJ f . The mixed 'H-z/'H-oo-design strategy can be defined as follows: Find a 
stabilizing controller Cq such that the. performance criterion J 2 (Co, tjn 2 ) is minimized 
where 


M^o) = min lim J 2 (C 0 ,t fn2 ) 

Co ^ f'H-2 

(3.19) 

J-iiCofifHi) = 

i=l 

4 (Co,i/«,) = £{zf 

(3.20) 

(3.21) 

where 


t Km 4(C 0 ,t fH2 ) = \\n(Co)\\l 

t fH 2 -+°° 

(3.22) 

subject to the constraints 


l|7i(Co)|U < 7 ' 

(3.23) 


for a stabilizhig controller Cq and all i = 1,2, ..n p . The n p parameters 7 ' are chosen 
by the designer and a 1 are n p weighting factors. 

This formulation is the mathematical equivalent to the problem posed in the last 
chapter. The ^-performance index J 2 ((7*) is the weighted sum of the individual 
(nominal) 7f 2 -norms for each plant condition while robust stability is imposed via n p 
^^ constraints. This is a constrained optimization problem where the H<x,-bound 
can be expressed in terms of any of the characterizations presented in the last chapter. 
In the overall optimization the performance cost can be expressed in terms of a finite- 
time cost or in terms of the system grammians which correlate to = 00 in the 
above definition. 
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3.3 The Tii-design problem 


Depending on whether the initial controller guess is stabilizing or not there are two 
possible ways of setting up the corresponding ?f 2 -problem computationally. If the 
initial controller guess is stabilizing, the i th performance cost can be computed via 
the controllability or observability grammians as follows. 


m(c 0 m 


Trace[( B l cl2 ) T L‘ 0 B l cl2 ] 
Trace[C' J: MCi,. 2 ) T ] 


(3 24) 
(3.25) 


where L' a and L\ solve 


(AU) T K + LiAi 2 + (C:,. 2 ) T Ci, a = 0 (3.26) 

KlK + K(Ki) T + ei,. J (B),, 2 ) T = 0. (3.27) 


On the other hand, if Co is not stabilizing the i tfl plant, ) can be expressed 

in terms of a finite-time cost function as 


•4(Co ,</«,) - rroce[jf‘ /Hl (^,, J ) T eWy r ‘(c;„) T c; u e^.'B;, i . i rf(] 
- rr«ce[ J‘ m c; u e^ , B;, i! (B;, i 2 ) T e l '':.)’''(Ci, 2 ) T rf(]. 


(3.28) 

(3.29) 


If the closed-loop system is stable, then in the limit as tjn 2 — > oo, (3.28) and (3.29) are 
equivalent to (3.24) and (3.25). The infinite-time approach in (3.24) or (3.25) is well 
known and is used in all current design approaches to the mixed Tii /Tioo -problem (e.g. 
[89]). An 7f 2 -approach based on a finite-time cost function in (3.28) and (3.29) was 
introduced in [64], where corresponding explicit gradient expressions were derived. 
The concept has been applied successfully to a variety of ^-problems. As already 
mentioned, this approach does not require an initially stabilizing controller. However, 
if the pure 7f 2 -problem is considered, the requirement for closed-loop stability has to 
be augmented in terms of constraints on the eigenvalues of A' cl for all plant conditions 
if certain observability/controllability conditions are violated. In either case, these 
representations are smooth and hence can be solved using standard gradient-based 
software. 
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3.4 The Tioc -design problem 

Notational Convention for ARFs and LMFs 

In chapter 2 a particular notational convention was not so important as no specific 
control strategy is considered there. Only closed-loop systems with an independent 
parametrization in terms of (A,B, C, D) are analyzed. When dealing with specific 
feedback control problems a more specific notation is needed. In the following “LMI” 
will refer to matrix inequalities that are linear in the sought-after solution X (see 
lemma 2.2.5) while “ARP denotes Riccati-type inequalities of the various types pre- 
sented in chapter 2 . In particular, the following forms (and parameter dependencies) 
for ARTs are used consistently throughout the remainder of this report. 

1 . ARI^ of (C 0 ,X\Y): 

Algebraic Riccati Inequality for the i th 7-foo-bound associated with the i th 
continuous-time (subscript C) plant condition for the output-feedback case 
(subscript OF) as a function of the controller matrix ( 7 0 , the sought-after so- 
lution X 1 for the i th ARI, and 7 *. 

2 . ARIcMCo.X^): 

Algebraic Riccati Inequality for the Tfoo-bound associated with the continuous- 
time (subscript C) plant for the full state-feedback case (subscript SF) as a 
function of the controller matrix Co, the sought-after solution X for the ARI, 
and 7. The plant index i is dropped in this case (see section 6.2). 

3. ARIoMC^X^) (or LM I d ,sf(Co, X, 7 )): 

Algebraic Riccati Inequality (Linear Matrix Inequality) representing the Hoo - 
constraint in the discrete-time domain (subscripts D) full state-feedback case 
(subscript SF) for a single plant (see appendix D). 

This notational complexity is necessary to address a wide variety of problems associ- 
ated with the Ttoo~ and mixed 'H 2 l'H 00 ~prQh\ems considered in this work. In partic- 
ular the dependence on the set 7* for the general output-feedback case and on 7 for 
the state-feedback case is included to extend the problem formulation to the optimal 
Woo-problem. With this convention we can now reformulate the FLoo -constraints in 
terms of matrix inequalities. 
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3.4-2 Reformulation of Ft^ -Constraints in Terms of ARVs/LMVs 

The T^oo-probleni in definition 3.2.1 is not as readily amenable to gradient-based 
methods. If the basic frequency-domain definition for the 'H^-novm is used to 
represent the desired Tfoo-costraints in definition 3.2.1, then the resulting overall 
optimization problem is not smooth. Alternatively the 'H OG -constv<i\nts may be ex- 
pressed in terms of n v ARE’s. This approach was taken in [89] and in [112], where 
a Lagrange multiplier approach has been utilized to append the TC ^-constraints in 
terms of ARE’s to the ^-performance cost. This formulation, however, imposes a 
variety of restrictive system assumptions as brought forth in [24]. In this research the 
Woo-constraints on the closed-loop systems are replaced by n p matrix inequalities. 
Any of the ARI’s (or the LMI) in lemmas 2.2.4 or 2.2.5 can be used for this purpose. 
It has to be kept in mind, that these inequalities will now be functions of the con- 
troller Co and their respective solutions X\ As a result of the above discussion the 
n v W^-constraints for the general output-feedback case as posed in definition 3.2.1 
can now be reformulated as follows. 

Definition 3.4.1 

Consider n p closed-loop plant conditions as in (3.16) satisfying the assumptions A1 
through Af. Then the suboptirnal Tioo design problem can be posed as follows: Find a 
stabilizing controller Co and a set ojn p matrices X 1 such that the following constraints 
are satisfied } 


1.) 

ARIh,o F (Ci o,X\Y) 

< 

0 

2.) 


< 

0 

3.) 

-x i 

< 

0 

4.) 

X 1 

— 

X' T 


for a given a set of n p Ft oo -bounds y (i = 1,2, ..n p ) as in definition 3.2.1 where 


ARI'c, of (C o,X\Y) 

= 14, + Bk4RT'(4,,~) T Ck J T x- 

(3.31) 


+X‘[A‘, + J 




- 1 ynr i 

^ y cl t oo 

w 

= (V)’/ -(DUfDU 

(3-32) 

S' 

II 

o) 

to 

l 

to 

'8^ 

to 

<7i_ 

*8^ 

(3.33) 
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Constraint 2 is a necessary condition for ||2 n < ^ 0 (Co, s)||oo < 7 % conditions 3 and 4 
specify the desired solution for the AR 1 and constraint 1 enforces the matrix inequality 
constraint itself. 

In general, if a controller Co can be found that satisfies all these constraints, then 
ARP cof (C 0 , X%Y) < 0 implies ||T^(C7 0 )|| oo < 7 1 . Unfortunately nothing can be 
said about the gap between (|T^(C 0 )||oo and the specified 7 *. That is, no means 
are available to determine “how close” the achieved 'H 00 -norm of the i ih closed- 
loop plant is to the specified robust stability bound 7 *. This gap will in general 
depend on the plant data, the controller and the “distance” between the eigenvalue 
X[ARI^ qf (Co,X\Y)\ < 0 and the origin. This formulation immediately poses the 
question of how to enforce matrix inequalities in a gradient-based formulation. A 
new novel method to reformulate constraints of this kind in terms of a scalar cost 
function will be introduced and discussed in chapter 4. 

3./f.3 State of the Art in "Hoo -Synthesis 

Based on the Youla parametrization (see e.g. [ 66 ]) it can be shown that the 'H 00 - 
design problem is in general infinite dimensional. The class of all suboptimal 'H 0 0 — 
controllers can be constructed from an arbitrary stabilizing controller and an ad- 
ditional (infinite-dimensional) 'W O 0 -norm-bounded transfer function Q(.s). This led 
to frequency-domain methods solving the so-called One-, Two- and Four Block 
problems. The main thrust for the application of Koo-methods to practical control 
problems were the DGKF equations ([24]). The parametrization of 7-Go-suboptimal 
controllers in terms of two Ric.cati equations provided an elegant and numerically 
tractable design method for the computation of 'W 00 -suboptimal controllers that are 
of the same dimension as the open-loop plant. The main drawback of this solution 
is the set of rather restrictive system assumptions imposed on the open-loop system. 
These assumptions include restrictions on the system zeros and rank conditions on 
various system matrices. Due to the rank assumptions this approach is known as the 
regular 1-Loo-problein and the resulting controller based on this approach is the Central 
Controller (as Q(s) - from the Youla parametrization - is assumed to be zero). The 
rank assumptions in the DGKF approach were removed in the work by Stoorvogel 
([113], [115]). There 'K 00 -suboptimal controllers are computed via the solution of two 
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quadratic matrix inequalities subject to rank constraints on two subsystems of the 
open-loop plant. Due to the removal of the rank assumptions this approach solves 
the so-called singular 'H 00 -problcm. However, this approach still requires assump- 
tions on the open-loop system zeros of the plants under consideration. Until recently 
this problem had to be circumvented via ^-perturbation techniques ([97], [45]). 

A new type of approach was initiated by Sampei et.al. ([98]) where the TLoo~ 
problem for output-feedback controllers has been posed in terms of two ARI’s. The 
system assumptions involve a minimal set of necessary constraints on the open-loop 
system, namely detectability and stabilizability. No further constraints are imposed. 
This was the first approach that removed the restrictive assumptions on the system 
zeros. This idea has been developed further and resulted in a (convex) parametriza- 
tion of all (full-order) T^oo-suboptimal controllers. Early exposition of this method 
may be found in [35], [36] and subsequently in [52]. The corresponding theorem is 
stated here (with the notation used in this report) for the sake of completeness and 
as a comparison to the approach taken in the presented formalism. 


Theorem 3.4.1 (Theorem 3.1 in [52]) 

Consider a controller of order n c and the -problem for the single plant case, i.e 
n p — 1. Then the following statements are equivalent. 

1. There exists a controller of order n c such that ||Too(Co, .s)||oo < 7- 

2. There are symmetric positive-definite matrices X and Y such that 


M 1 


AX + XA T + B 2 BJ XCfi + B 2 D T 22 
C 2 X + D n Bfi D 22 Dj 2 -t 2 / 

YA + A T Y + CjC 2 

B T 2 Y + D T 22 C 2 



< 0 


< 0 


> 0 


ran 


k(I-XY) < 


n r 


(3.34) 

(3.35) 

(3-36) 

(3-37) 


B 3 

7^23 


where the columns of L form a basis for Af[ 
represent a basis for C 3 D 32 )]• 


and the columns of M 



47 


A parameterization of the controller C(s) in terms of X and Y is given in theorem 
3.2 in [52]. This formulation constitutes the “state of the art” in Woo-synthesis, 
as all suboptimal 7Yoo - controllers of order n c = n x can be derived from the solu- 
tion of two linear matrix inequalities along with a coupling condition. Unlike in the 
LQG-philosophy the separation principle is no longer valid. That is, the optimal 
output estimation and full information control problem (the 'W 00 -equi valent to the 
full state-feedback problem in LQG-theory, see [43]) cannot be treated separately in 
Woo-control. The coupling condition (3.36) is a necessary condition for closed-loop 
stability. The above theorem completely characterizes all full-order Tfoo-controllers 
(i.e. n c = n x ) in terms of the three inequalities (3.34), (3.35) and (3.36). It im- 
poses the least number of system restrictions and, in particular, does not make any 
assumptions on the system zeros. 

For fixed-order controllers, however, the additional constraint (3.37) has to be 
satisfied. Rank constraints are hard problems to solve and are the subject of on-going 
research (see e.g. [36], [37]). Furthermore, the controller parametrization follows 
directly from the solutions X and Y of the above inequalities. Hence this approach 
is not applicable to design problems where the controller is structurally constrained 
or problems with multiple plants as proposed in this work. Most importantly, the 
above formulation also leads to the fundamental problem of how to enforce matrix 
inequalities. This problem will be addressed in the next chapter. 


3.5 Robust H 2 - Performance - Some Recent Results 


The problem of robust ^-performance is to a large extent still an unsolved problem, 
as pointed out in the introduction. However, some promising results for this problem 
have been derived in [39] and [83]. An ARE-based approach is used to define an 
upper bound for the cost for all considered uncertainties with a given 77^-norm 
bound. A different approach to define an upper bound for the robust ^-performance 
measure has been investigated in [114] and [117]. The approach is intuitive and is 
briefly reviewed here as it allows an interpretation - and possible extension - of the 
presented results to the problem of robust ^-performance. For this purpose consider 



the n p closed-loop systems £3/00, d(Co) in (3.14), 


J 2/oo, cl 


(Co) 


KM 

■ ^ 
II 

(t) 

+ 

B d,2 W 'M) 

+ 

B d, oo<o(0 

m 

— ni r 

- cl;2 x 

i.M 



+ 

OkooMooC) 

zL(t) 

— C l 

' C.ly oo‘ 

KM 

+ 

D d,2,oo W M) 

+ 

D cl, oo<cV) 


with the uncertainty block A l (s) connected to this system in a feedback connection 
such that tc^.s) = A z (.s)2j o (.s). For the results derived in [117], A*(.s) may be linear, 
nonlinear, time-varying or time-invariant, providing a generalization of the stan- 
dard 7^00-assumption on the uncertainties. Without any knowledge on the internal 
structure of A*(.$) the uncertainty is allowed to contain a “direct feedthrough term”. 
With D l c i 2 t oo 0 this would cause a direct feedthrough term from W 2( S ) to <o(' S ) 
and through the uncertainty to z 2 (s). As a result the Hi norm of the transfer func- 
tion from ic 2 (.s) to 2 2 (s) would be infinite. Thus as in [117] we need to ensure that 
B cl, 2,00 = 0- Although having Z)’ /oo2 = 0 would yield the same result, it is assumed 
here that D' cl 2>00 = 0 with possible D' / oo 2 ^ 0. For this case the relevant transfer 
functions and their corresponding input/output mappings and state-space realiza- 
tions are given in terms of the closed loop matrices. Here a closed loop system is 
related to the system configuration with a controller Co and not with the uncertainty 
A'(.s). 


TU(C »,») 

w 'oo(K •-> Z ‘oo(Ki 

TL(C o) 

■ ^ 
II 

P >1 s-ii r\i } 

^C-ly oo’ K ' cl } oo? ooj 

n.«,(c 0 ,s) 

wi(s) ^ 2^(.s), 

T loo(Co) 


^,2,C* /)OO ,0] 

Ti, 2 (C„, 5 ) 


TLACo) 

■■= [AU, 

Befool t'cl, 2 ’ D'cl, 00 , 2 ] 

T.i(Co, S ) 

«>a(s) i-> z* 2 (s), 

T-i(Co) 

■■= [A**, 

Bel, 21 ('cl, 21 0]* 


Obviously Tj(Co, .s) and 7^ (Co, s) are the closed-loop transfer functions for the nom- 
inal problem. With the additional cross coupling terms T 2oo (C 0 ,,s) and T^ 2 (C 0 ,- s) 
along with the i th uncertainty A'(.s) it can be shown that the transfer function 
T‘ a (C 0 ,.s) from w l 2 ( .s ) to z 2 (.s) with both the controller Co and the uncertainty block 
A ! (.s) closed in the i th system has the following form. 
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By applying appropriate system norm inequalities it can be shown that (lemma 2.3, 
[117]) 


II 7 2,a( c 'o)|| 2 < ll^(c; 0 )|| 2 + 


ll^, 2 (g 0 )Hoo||A«|| 
1 - l|A i ||co|in > (C'o) 


■ 11 ^, 00 (^) 112 . 


(3.40) 


This inequality gives rise to a range of observations and interpretations for the nominal 
7^2 design formulation in this work. For the nominal 7 Y- 2 -problem obviously the term 
■Too, 2 (^ 0 ) s) is assumed to be zero and hence the second term on the right side of 
inequality (3.40) is neglected. In face of (3.40) and with the capability to include 
multiple plant conditions, one can define an “upper bound robust 7 "f 2 — performance 
problem with robust stability” using the following design objectives 


1 . Minimize a weighted sum of ||Tj(Co )|| 2 and ||X’ >oo (C' 0 )|| 2 , 

2 . Minimize the / H 00 -norms of T^Co, 5 ) and 2 ((7 0 , s) for given TGo-norm bounds 
on the uncertainties A'(.s), 


3. Guarantee robust stability for all plant conditions in terms of the Small Gain 
Theorem by ||A i || 00 ||Xi > (C'o)||oo < 1, 

for all 1 . i = 1,2, ...,n p . It should be noted, that inequality (3.40) does not place 
any assumptions on the uncertainties A*(.s), not even causality. This may cause the 
upper bound in (3.40) to be very conservative. At this point there is no theoretical 
means to compute the gap between the actual worst-case norm ||X 2 ‘ A ((7 0 )|| 2 and the 
upper bound. The true robust ^-performance problem not an upper bound - is 
a problem that has yet to be solved. However, inequality (3.40) has implications for 
the nominal 7^ 2 -problem. In particular, after a design has been performed for the 
nominal problem, it is always possible to compute an upper bound for the robust 
^-performance given by the right-hand side of inequality (3.40). 


Although these ideas are not pursued further in this work, the stated results allow 
the designer to easily compute a guaranteed ^-performance cost for all possible 
uncertainties and hence an upper bound for the robust Tf 2 -performance cost at the 
i th plant condition, regardless of which design method is used to derive the controller. 



Chapter 4 


SYMMETRIC MATRIX-INEQUALITIES, THEIR ROLE 
IN CONTROL SYSTEMS THEORY AND A NEW COST 
FUNCTION FOR THEIR ENFORCEMENT 

4.1 Matrix Inequalities 

A wide variety of control problems can be reduced to matrix inequalities. In the past 
such criteria have largely been neglected as they do not allow the computation of 
analytical one-step solutions. The representation of 7Yoo-constraints is one of many 
problems that can be casted as a matrix inequality constraint. Stability, for example, 
can also be characterized in terms of parameter dependent Lyapunov inequalities. 
Present approaches to //-synthesis convert the general min-max problem to a se- 
quence of optimization problems involving the minimization of the TYoo-norm of a 
scaled constant matrix. This formulation in turn can be expressed in terms of matrix 
inequalities. Present Tl^-synthesis methods often yield unstable controllers which 
are undesirable in practice. The requirement for a stable controller, however, can be 
easily translated into a Lyapunov-type inequality constraint. Other applications of 
matrix inequalities are optimization problems involving maximum generalized eigen- 
values, minimum dissipation constraints, Hankel norm constraints, inverse optimal 
control problems and many more. A forthcoming book by Boyd et. al. contains a 
very complete list of such problems and their conversion to matrix inequalities (see 
[15]). Presently, however, there are no reliable gradient-based methods available to 
find solutions for such inequalities. 

In the following let us consider a general problem as follows. Let Q(v) be a real 
symmetric matrix-valued funtion of a set of independent real variables v . That is, the 
expression Q(u) defines a mapping of the variables v to the general set of symmetric 
matrices as follows. 


Q(v):v^Q(v), veR p , Q(v) = [Q{v)] T e R qxq . 


(4.1) 
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For this kind of matrix-valued function we consider the following inequality constraint 


Q{v ) < 0. 


(4.2) 


This formulation is general and includes all the above control problems with proper 
definitions of Q(u). 

4.2 Present Solution Methods 

Present approaches to enforce matrix inequalities include non-differentiable methods 
such as Kelley’s cutting plane or ellipsoid methods. These methods are based on 
subgradients and cannot be integrated into a gradient-based formulation. Other 
approaches such as homotopy methods have been successfully applied to solve these 
problems. The only differentiable scalar function defined for the computation of 
solutions to inequalities is an “interior point” method and can be found in [15], [14], 
There the following barrier function has been defined. 


<j)(v) 


log det[—Q{v)] 1 v E V 
oo v V, 


(4-3) 


where V is the set of feasible solutions such that v E V =>• Q{v ) < 0. This type of 
barrier function has been successfully applied to scalar inequality constraints (see e.g. 
[63]). For matrix inequalities, however, a closer look reveals that 4>(v) is a barrier 
function only by definition, not by virtue. That is, one can easily find problems where 
Q(v) is sign-indefinite or even positive definite and log det[— Q(u)] -1 still remains fi- 
nite. This will happen whenever the number of positive eigenvalues of Q( v) is even. 
In general, when moving from the scalar case to the matrix case one has to take into 
account the multi-dimensional nature of the problem at hand. Also, because (f>(v) 
is an interior point method, the initial guess for this method must a— priori satisfy 
the constraint. Hence this function is applicable in a gradient— based optimization 
only when a solution for the desired constraint is known a-priori. Presently such a 
“guess” is generated using the non-gradient based methods listed above. In the fol- 
lowing section a new time-domain cost function is defined that removes the problems 
associated with <p(v). 



4.3 A Scalar Differentiable Cost Function to Enforce Matrix Inequalities 

In this section we consider the problem posed in equations ( 4 . 1 ) and ( 4 . 2 ). For this 
feasibility problem we define the following time-domain penalty-function )• It 

is a function of the independent variables v and an auxiliary positive scalar parameter 
tf . Namely, 

/(»,</) = Tract{e^ v ^}. ( 4 . 4 ) 

This cost function is an extension of scalar penalty functions to the matrix case and 
posesses many attractive properties as elaborated in the following section. 

Due to the fact that Q(v) is symmetric, negative definiteness of Q{v) is equivalent 
to Q(v) being stable. The matrix can be interpreted as the transition matrix 

of a system e(t) = Q(v)e(t) and hence the inequality constraint 2(e) < 0 can be 
interpreted as a stabilization problem. This justifies the classification of f(v,tj) as a 
time-domain function. It is easily verified that the defined cost function f{v,t f ) can 
be rewritten as 

= J2 eHQ{v)]tf - (4.5) 

2 = 1 

That is, f(v,tf) consists of the sum of the exponential of the eigenvalues of C(u) 
(weighted with tf). For symmetric Q(t>), it is known that all eigenvalues of Q(u) 
are real. The key property associated with the penalty function f{v,i f ) and the 
constraint Q{v) < 0 is expressed in the following theorem. 

Theorem 4.3.1 

Consider a real symmetric matrix inequality constraint of the form Q(v) < 0, Q(v) = 
[Q(u)] T € ft qXq and the penalty function f(v,tf) defined in (4-4). Then the following 
statements are equivalent. 


1. Q(v) < 0 (4.6) 

2. lim f(v,tj) = 0. (4.7) 

t f — KX) V ' 

F } roof: 1 . — > 2.: If Q(v) < 0 is satisfied then all the eigenvalues of 2(n) are real and 
negative. With (4.5) this directly implies assertion 2. Conversely, if lim f(v,tf) = 0 , 
then all eigenvalues of 2(u) must be negative and hence 2(u) is negative definite. ■ 



Theorem 4.3.1 shows that matrix inequalities can be enforced using the scalar cost 
function Furthermore, in the limit as tj — *■ oo, f(v,tj) is zero if and only if 

the matrix constraint Q(v) < 0 is satisfied. On the other hand, if (2(u) has at least 
one positive definite eigenvalue, then the cost function will be unbounded as if —* oo. 
Although numerically irrelevant, it may occur that t2(e) has eigenvalues directly at 
the origin. As Q(v) is assumed to be a q X q matrix, Q(v ) has at most q eigenvalues 
at zero. Hence for any tj > 0, f(v,tf ) will satisfy 

Q{v) < 0 4=4> 0 < f(v,tj) < q, (4.8) 

where the exact function value depends on the number of eigenvalues at zero. Con- 
versely, for tj > 0, 

f(v,t/) < 1 Q{v) < 0. (4.9) 

Furthermore, if Q(v ) < 0, then there will always be a 1; > 0 such that (4.9) is 
satisfied. These considerations are summarized in the following corollary to theorem 
4.3.1. 

Corollary 4.3.1 

Consider a real symmetric matrix-valued function Q(v) as follows. Q(v ) = [<2(v)] T € 
R qXq with v G R v and the penalty function /(u, t f) defined in (4-4). Then the following 
statements are equivalent. 

1. Q(v) < 0 (4.10) 

2. 0< lim f{v,tf) < q (4.11) 

tf—*’ OO X 7 

( 2'. lin^ f(v, t j) is finite ). ■ (4.12) 

Moreover, for the strict inequality Q{v) < 0 there always exists a large, but finite, 
tj > 0 such that f(v,tj ) < 1. 

Clearly, in the limit as tj — > oo, f(v,tj) represents an interior point barrier function 
for the matrix-valued constraint Q(v) < 0. In a practical implementation, / j can be 
large but not infinite. It is easily verified that f[v,tj) is well defined for any positive 
finite tj , even if the constraint Q(u) < 0 is violated. Hence, for any positive finite 
tfi f( v itf) is an exterior point penalty function. This property is attractive since 
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it allows the optimization of the cost function to be performed for increasing values 
of tj until the constraint is satisfied. The problem at hand is to find a v such that 
the maximum eigenvalue of Q(v) is negative. It is well known that such maximum- 
eigenvalue problems are in general non-smooth. In this formulation all eigenvalues 
contribute to the cost function. The more negative the k th eigenvalue is, the smaller 
is its contribution to the overall cost. Assume that the maximum eigenvalue A[Q(u)] 
of Q(v) is positive while all other eigenvalues A^.[Q(r?)] are negative. In this case tj 
can be chosen such that > e (AA =f Q(, h])</ f or a p ^ w here A k[Q{v)} ^ A[Q(t;)]. 

Then the desired maximum eigenvalue problem is approximated while, in the limit, 
as tj — > oo, only the maximum eigenvalue (or eigenvalues) will contribute to the 
cost function. Generally, in a numerical implementation, it is desirable to increase 
tj rapidly to large values so that only the remaining positive eigenvalues of Q(v) are 
penalized. 

4-3.1 Convex Matrix Inequalities 

To emphasize another important property of the cost function f(v,tj) in (4.4), let 
us look into two alternative cost functions that can be used to compute solutions for 
matrix inequality constraints. Such alternative cost functions f{v,tj) and f{v,tj) 
include - but are not restricted to - the following functions. 


Q 



*= i 

(4.13) 


( ( e O*[e(v)] f/ > _ i)2 if\ k [Q( v )]>o 
i 0 if Afc[Q(t>)] < 0, 


fk(v,t f ) = 

(4.14) 

/(M/) 

= 

Ar=l 

(4.15) 


1 tfiMQMl) 2 if A fc [<2(t;)] > 0 
1 0 ifXk[Q(v)]<0. 

(4.16) 


Due to the symmetry assumption on Q(u), Q{v) can be diagonalized for any v and 
hence /(n,ty) and are continuous and differentiable in v as long as Q(v) is 

continuous and differentiable in v. In this formulation the k th eigenvalue of Q(v) 



contributes to the overall cost function only if it violates the desired constraint. In a 
numerical implementation these alternate cost functions will be superior to f{v,tj) 
for small tj. The reader is reminded that in f(v,tj) all eigenvalues will contribute to 
the cost function, regardless of their sign. Eigenvalues that satisfy the inequality will 
be negligible in f(v,tf) only if tj is large. However, f(v,tf) has one advantage, that 
both f(v,t f ) and f(v,tf) do not share. Namely, they are not convex in the considered 
parameters u, even if the underlying matrix function Q(v) is convex. Conditions for 
a scalar function to be convex are well known. This concept has a direct equivalence 
for symmetric matrix functions. 

Definition 4.3.1 

Consider a real symmetric matrix-valued function Q(v) of the form Q(v ) = [Q(u)] T G 
ft' 1 x q with v G R p . Let Vj G Ft? , v 2 G Ft? and a G [0, 1], then Q(v ) is a convex matrix 
function if 

Q[mq + (1 — a)u 2 ] < o^rq) + (1 — a)Q(u 2 ), (4-17) 

where convexity is defined in terms of the usual ordering of symmetric matrices. 

With this definition we can state a very important property of f(v,tj) in the following 
theorem. 

Theorem 4.3.2 

Consider a real symmetric convex matrix-valued function Q(v) with Q(u) = [Q(u)] T (= 
R qXq and v G Ft?. Then, for a given tj, f(v,tj) is convex in v. 

Proof: Since Q(v) is convex in v, there is a positive semi-definite matrix Q such that 


Q[av t + (1 - «)u 2 ] = «Q(ui) + (1 - a?)<2(v 2 ) + Q. (4.18) 

Then the following chain of equalities and inequalities prove theorem 4.3.2. 

/[m + (1 -a)v 2 ,t f ] = 7 1 roce{e fi[OTl+(1 - a ' )v2] ^} (4.19) 

= T ?’ace{ eJ a Q.M+Q]tf } ( 4 . 20 ) 

< Troce{e [ae(, ' l)+( 1 - a)c(, ' 2 »b} (4.21) 

< [rrace{e G(, ' ,) ^}] a [7 , race{e c( ^ ) ^}] (1 -“) (4.22) 

< aTrace{e Q{v ' )l f} + {l - a)Trace{e QMt '} (4.23) 

< afiv^tj) + (1 - a)f(v 2 ,tj). (4.24) 
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Here we have used equation (4.18) to show the equality of (4.19) and (4.20). Equa- 
tion (4.21) follows immediately from Weyl’s theorem (appendix A), the monotonicity 
property of eigenvalues of hermitian matrices and the fact that the (scalar) expo- 
nential function is a (strictly) monotonic function of its argument. Equation (4.22) 
is a direct consequence of lemma A. 1.6 in appendix A. The final result follows from 
the arithmetic-geometric mean inequality (lemma A. 1.5 in appendix A), applied to 
equation (4.22). This concludes the proof of theorem 4.3.2. ■ 

Note that this convexity property does not depend on Q(u) < 0 and hence is 
valid even if the desired inequality constraint is violated. This property is clearly 
illustrated in the scalar case. Let us consider = e vt f for a real scalar v . 

Obviously — = t'je vt f > 0 for any real scalar v regardless of the sign of v and 
hence convexity follows. This is a very powerful result as it allows the representation of 
convex matrix inequalities as convex differentiable constraints in an overall gradient- 
based optimization scheme. This is of particular importance as more and more control 
problems are defined in terms of convex (linear) matrix inequalities ([15]). 


4 • 3. 2 G radi e n t Co mp utation 

To be able to utilize the defined cost function in an efficient gradient-based scheme, 
it is important to have explicit gradient expressions available. The derivation of such 
gradient expressions is presented in this section. A first important result is the fact 
that if Q(v) is continuous and differentiable in u, then so is f(v,tf)- Assuming con- 
tinuity of each entry of Q(u), a standard result from perturbation theory states that 
the eigenvalues of Q(u) are continuous in v. Hence, by use of equation (4.5) and the 
fact that the (scalar) exponential of a function is a continuous, strictly monotonic 
function of its argument, continuity of in v follows immediately. Differen- 

tiability in this context refers to the component-wise differentiability of the (i, j)-th 
entry of [Q(u)] tJ with respect to individual components v k \ k = 1,2 , ...p of v. With 
the symmetry assumption on Q(t>), Q(v) is diagonalizable for any v and hence gra- 
dients for A{[Q(u)] are well defined (see e.g. [67]). By use of equation (4.5) it is 
easily shown that f(v,tj ) is differentiable with respect to v as well. Henceforth it 
is assumed that Q{v) is continuous and differentiable with respect to u. Note that 
in the above discussion no restriction has been placed on the form of v. A repre- 
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sentation of v in t2(n) may in general he a scalar, a vector or a matrix. Explicit 
gradient expressions depend on the considered matrix inequality. However, a general 
form for these gradient expressions can be derived using a power series expansion of 
the matrix exponential in f(v,t f ). With the differentiability of Q(v) at a point v a , a 
linearization of Q(u) at v Q can proceed as follows. 

Q(v 0 + dv) = Q(v 0 ) + dQ(v 0 , dv) + r(dv) (4-25) 

where dQ(v 0 ,dv) is the variation of Q(v) at v a due to a variation of dv around v a . 
dQ(v 0 ,dv) is linear in dv such that dQ(v 0 ,dv) = 0 for dv = 0 and r(dv) collects all 
higher-order terms in dv. Disregarding the term r(dv), the power series expansion of 
Q(v 0 + dv) becomes 


f(v 0 + dv,tj) = Trace{e [Q ( v ° +dv ^f} (4.26) 

= Trace{e [Q[Vo)+dQ{Vo ' dv)]t t} (4.27) 

OO jk 

= Trace{^T-jL[Q(v 0 ) + dQ(v 0 ,dv)] k } (4.28) 

= + + (4.29) 

= Trace{e [Q{Vo)]t f} + t f Trace{e [Q{v ° )]t < dQ(v 0 ,dv)} (4.30) 

= f(vo,tf) + tfTrace{eM'’°WfdQ(v 0 ,dv)}. (4.31) 

Going from equation (4.28) to (4.29) higher-order terms in dv have been neglected 
and the property Trace(LM) = Trace(M L) for any compatible matrices M and L 
has been used. Hence we have derived the following expression. 


f(v 0 + dv,t f ) - f{v 0 ,tf) = t f Trace{e^ v ^dQ(v 0 ,dv)}. 
If we can express tjTrace{e^ Vo '^ t fdQ(v (n dv)} as 

t I Trace{eW v °n t fdQ{v 0 ,dv)} = t J Trace{K(v 0i t f )dv }, 
then, according to Kleinman’s lemma ([133], appendix A) we have 


(4.32) 


(4.33) 




v=v 0 = t } [n(v 0 ,t s )\‘ 


(4.34) 
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Once again, this derivation is independent of the particular representation of v . That 
is, in the above derivation v may be a scalar, a vector or a matrix. This result 
allows the computation of explicit closed form gradient expressions for a variety of 
matrix inequality constraints. As Q(v) is symmetric and hence diagonalizable, gra- 
dient expressions can also be expressed in terms of the individual eigenvalues and 
corresponding eigenvectors of Q(v) using (4.5). This procedure is illustrated further 
in the appendices. 

For the cost function = Trace{e } it is obvious that, if the desired 

inequality constraint Q(v) < 0 is satisfied, then f{v,tj) .= 0 in the limit tj — > 
oo. The question arises if this is the case for the gradients as well. The answer is 
affirmative. This is a very important fact for the optimization process to be applied 
to this problem. To illustrate this property consider the scalar problem Q(v) = id 
for a scalar id. I he corresponding inequality constraint under consideration is then 
id < 0 and the cost function in (4.4) has now the following form: f(v,tj) = e yitf . 
The trace operator does not have to be applied in this case. The gradient for this 
case is easily computed to be 


dt vl f 

= t/e f 
dv 1 f ' 

(4.35) 

If the inequality is violated, the gradient expression (4.35) will obviously go to infinity 

in the limit as tj — >• oo. On the other hand, if td < 0 is satisfied, 
rule can be applied to show the following. 

then L’Hospital’s 

lim tfe v ' tf = lim — 

tf—*00 tf —> OO £ — v 

(4.36) 

= lim — d — tt 

tj —* oo — id e v 

(4.37) 

= 0 

(4.38) 

where we have used — td > 0 and hence lim f .^oo — v 1 e~ v ' t f = oo. 

In general it can 


be shown that tje v tf as a function of tj has minima at tj =0 and tj — oo and 
a maximum at tj — for id < 0. Equivalent conclusions can be drawn for the 
general matrix case as well. With the assumption that Q(v) is not a function of tj 
and the representation of f(v,tj) in terms of the eigenvalues of Q(v) in (4.5), the 
above limiting argument for the general matrix case can be reduced to the scalar 
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case. With v = {e\e 2 , . . . v p } and 


l-l 


the partial gradient with respect to one component of u, say t>*, is computed from 


if) _ y-, ^i[Q(^)] \AQMUf 
dv k ^ dv k 


(4.39) 


As 2MSM 

that 


is not a function of tj , the above argument is directly applicable to show 


lim 

tf-*oo 0v k 


= 0 


(4.40) 


if all A,-[Q(t>)] < 0. Hence, the cost function defined in (4.4) not only has the property 
that the cost function value will diminish, but the gradients tend to zero as well when 
the considered inequality constraint is satisfied and tj — > oo. 


Note that the block structured matrix inequalities (2.28) can also be handled with 
this scheme. In this case the particular block-structure has to be exploited when 
forming 7 Z(v 0 ,tf) in equation (4.33). For example, consider a constraint Q(u) < 0 
where Q(v) has the following 2 x 2 block structure, 


Q( V )= { 

' 1 QUv) Q 22 (v) 




(4.41) 


The corresponding structure for the matrix exponential of Q(u) is 




= £ {v)= ( £ "M «■><») V 

\ £u( v ) £-n(v) ) 


(4.42) 


Then equation (4.32) for this block-structured constraint is as follows. 


f(v 0 + dv,tf) — f(v 0 ,t/) = tjTrace{£ u (v 0 )dQ u (v 0 idv) + £] 2 {v 0 )dQ[ 2 (y 0 , dv) 

+ £22(v 0 )dQ 22 (v (n dv)}. 

(4.43) 
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Following the derivation in (4.33) and (4.34), the gradient expressions will now depend 
on the corresponding block structure of Q(u) and £(u) respectively. This scheme is 
easily extended to matrix constraints with more complicated block structures. This 
implies that gradients can be computed for any block-structured matrix inequality 
Q(v) as long as Q(v) is continuous in the parameters v. Thus the cost function can 
be applied to enforce LMI-constraints according to equations (2.28), (2.29) or (3.34)- 
(3.36). Explicit gradient expressions for the ARI’s representing 7Tx>-constraints are 
included in appendix B. 

Convex (and especially linear) matrix inequalities form a very special class. For 
matrix inequalities Q{v) that are affine and hence linear in u, gradient expressions for 
can always be derived explicitly. Let v x ,v 2 , ...v p denote the individual real 
scalar elements of v. For the class of affine matrix inequalities, we may write Q(u) in 
a standardized form. 


G(v) = Q° + v'Q' +v 2 Q 2 + ... +v p Q p (4.44) 

= Q°+tv k Q k (4.45) 

A;=l 

where Q v and Q° are constant matrices. With Q(v) given in (4.45), partial derivatives 
with respect to v l are simply 

= t / Trace{e Q ( v)t ’Q x }. (4.46) 

Although numerically interesting, this formulation has a drawback. In most inequal- 
ity constraints the scalars v l will represent the elements of some matrix (e.g. a 
controller representation Co). Explicit gradient expressions as a function of this ma- 
trix often provide important structural information for the problem at hand. This 
information of the matrix constraint in its original form may be “hidden” in this 
standardized form. This will be seen later, when gradient expressions for various 
ART 's are analyzed. Even for the standardized form it is difficult to obtain explicit 
closed form second-order gradients. A characterization in terms of infinite series is 
possible ([67]). However, using the identity (A.80) in appendix A and the tools for 
finite-time cost function gradients in [64] it appears to be possible to derive com- 
putable expressions for the second-order gradients. Future research along these lines 
should prove valuable. 
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4.4 Summary 

1. In this chapter a new scalar cost function has been defined that allows the 
substitution of real symmetric matrix inequalities by a scalar constraint in an 
overall optimization context. For finite t j this function plays a role as an exterior 
point penalty function while in the limit, as tj — * oo, f(v,tf) becomes an 
interior point barrier function for the matrix inequality constraint. Unlike the 
formulation in [15] (see equation (4.3)), this cost function is a true barrier 
function in the limit as tj — > oo. 

2. Let V\ E /f ni , V 2 6 /? U2 , ...,u 7lp E /2 np , then multiple matrix constraints of the 
form 

[Ql(vi) < 0, Q 2 {v 2 ) < 0, Qn^Vn,) < 0] (4.47) 

are easily transformed into n p scalar constraints 

lim^—oo TVaceje^d 1 ' i)k/} = 0, 
linp _oo TraceAe}^ 2 ^ 2 ^ 1 } } = 0, 

7 J (4.48) 

lim^-.oo Trace{e^ n p^ Vn ^A } — 0. 

This framework allows the incorporation of multiple / ft (X) -constraints into any 
performance optimization problem. It is known that the central controller is 
unstable if certain subsystems of the open-loop plant have right-half plane 
zeros. In the presented formulation the requirement for a stable controller is 
easily incorporated by additional matrix constraints such as AjY + YA c < 0 and 
Y = Y T > 0. Eigenvalue constraints on the closed— loop system can be added 
in the form of inequalities [A cl + aI] T Y + Y[A ci + c*7] < 0 and Y = Y T > 0. 

3. The technique is applicable to TCo-problems in the continuous-time domain 
as well as in the discrete— time domain in terms of ARI’s or block-structured 
LMI’s (see appendix D). 

4. If Q(u) is differentiable with respect to v, then is also differentiable. 

Explicit (closed-form) gradient expressions have been derived according to the 
scheme outlined in equations (4.25) through (4.34). For many types of matrix 



constraints the gradient computation involves only a matrix exponential and 
elementary matrix computations such as matrix multiplication and addition. 
Hence gradients can be computed very efficiently. 

If the underlying matrix inequality is not convex in the considered parameters, 
then the cost functions }{v,tf) and in (4.13) and (4.15) respectively 

can be used for the problem at hand. However, if the matrix function Q(v) is 
convex, then, for a given £/, the scalar cost f(v,tj) is also convex. In general 
f(v,tj) and f(v,tj) will not be convex. Convexity of for convex Q(u) is 

a very important feature of the cost function in (4.4) which allows its application 
to a large class of important control problems. 



Chapter 5 

A NEW APPROACH TO ^-SYNTHESIS 


In this chapter we will concentrate only on the Woo^design problem. With the cost 
function defined in (4.4) it is obvious that the corresponding 'W 00 -constraints in the 
overall Pli/PCoo -design problem are merely a set of scalar constraints added to the Pti~ 
optimization problem. Hence it is important to numerically and theoretically analyze 
the pure 7"too-problem in this formulation before applying it to the overall mixed 
strategy. The extension to the mixed performance/stability robustness problem will 
follow naturally from these considerations. 


5.1 Multi-Plant 'H 00 ~Design Problem in Terms of a Scalar Cost Function 

For the pure Woo-problem inherent to the mixed PL 2 /Woo design, we assume w 2 (t ) = 0 
for i — 1,2, n p in the open-loop systems given in (3.1). The n p closed-loop systems 
subject to Tioo-constraints are 


^ 00 , cl 


(Co) : 


<o(C 


A^xUt) + B^wUt) 

C‘/,oo4o(0 + ^,00 <(t) 


(5.1) 


with 


Ai, 

= A 1 

+ 

&)C 0 Q 

B'd, 00 

= 

+ 

B^CoDy 2 

ni 

c/,00 

= c* 

+ 

^23^0^3 

n i 

U cl } 00 

= £>22 

+ 

D l 23 C 0 D32 


where all the relevant matrices have been defined in chapter 3. With the cost function 
defined in (4.4) we can now rephrase definition 3.4.1 for the pure 7-foo-design 
problem. Note that we consider at this point the suboptimal "Hoo-design problem 
and hence 7* for i = l,2,...,n p are assumed to be specified a-priori (a possible PLoo- 
optimal design strategy will be discussed in section 5.4). In this case one searches for 
a controller that satisfies all the n p ^-constraints ||T4(C 0 )||oo < f simultaneously. 
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Definition 5.1.1 

Consider n v closed-loop plant conditions given in (5.1) satisfying the assumptions A l 
through Af. Then the 'H 00 -design problem for the general multi-plant output-feedback 
case can be posed in terms of f(v,tj) as follows. Find a controller Cq and a set of n v 
matrices X 1 such that the following constraints are satisfied: 


1.) 

,lin> r A R lcr ,AO 0 ,X\Y,t) 1 ) = 

'/l— 00 

0 

2.) 

Uni f' D (Co, t) 2 ) = 

0 

3 .) 

lim f' x (X\t ) 3 ) = 

7^— ► OO 

0 

4 .) 

X' = 

(X') T 


with 

f\Ri t , OF (C 0 ,X'n\f n ) 

fb(C o,7%) 

and 

AMc of {Cq, X\ Y) 

W 

$' 

with rip pre selected 7'obust stability bounds 7 * and a set of real positive scalars t l j k 
(k — 1,2,3 and i = 1 , 2, n p ). 

The real positive scalars t l j k in this formulation are used as scaling variables to con- 
dition the numerical behavior of the algorithm as discussed below. Constraint 2 in 
(5.3) ensures that 5{D % d oo ) < 7 * and forms a necessary condition for ||T^(Co)||oo < 7 *. 
Constraint 1 imposes the actual ARI-matrix inequality constraint for the Woo-bound. 
Of course, the expression for ARP cof (C 0 , X\ Y) in (5.7) for the i th plant condition 


= K,+ Bi,«(flr'(^ l ,oo) r (-i,J T -V i (5.7) 

+*‘14, + 4,„(fiT'(4.»o) T QJ 

+*'4,=.(Kr , (4,») T *' + (yrtCiWc*. 

= (7 '?! - (D',,oo) T Oii,«, (5.8) 

= ( 7 ‘ft - Di, x (D<f (5.9) 


— T race 

{ e AMc,oF( c «> x 'n')t),} 

(5.4) 

= Trace 

{e -n't) 2] 

(5.5) 

— Trace 

{e- x,t h} 

(5.6) 
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can be replaced by any of the equivalent characterizations described in chapter 2 . 
The constraints 3 and 4 in (5.3) impose the symmetry and positivity constraints on 
all X'. Note that all O l cl oo and hence all R l and S' are generally functions of the 
controller parameters in Co. For notational simplicity this dependency is omitted in 
the remainder of this report. For the further discussion the following sets are defined. 


X 

Tj 

G 


= {X i :X i = {X i ) T ,i=\,2 ,..,n p } 

= it 1 i 2 i Up F i 2 i n P i 2 + n P \ 

l 1 f 1? l j l? *'/ 1? 1 j 2? *'/ 2’ •••i <7*2 <73 ’ - i *7 3 J 

= { 7 1 , 7 2 , 7 np }• 


(5.10) 

(5.11) 

(5.12) 


The set X collects the n p symmetric matrices X x in the above problem description, 
T f is the set of all scaling factors t' fk ( k = 1,2,3 and i = 1,2 and Q collects 
all the prespecified TY^-bounds 7 *. With a slight abuse of notation the expressions 
‘Mim 11 and — > 00 ” mean that the individual elements of 7 } approach infinity 

and do not imply an infinite number of elements in X/. The expression “finite X/” 
will refer to elements in Tj being finite and not to the number of elements in 7}. 


5.2 Analysis of the Individual Cost Functions 
5.2.1 Algorithm Outline 

The formulation of the multi-plant suboptimal problem with the cost function de- 
fined in chapter 4 makes the solution readily amenable to gradient based parame- 
ter optimization methods. Definition 5.1.1 leads to an iterative scheme where the 
set Tj can be used to properly scale the cost functions. Depending on the initial 
guesses and the maximum eigenvalues of the matrix expressions ARP C of (Cq, 

[{y) 2 I — {D l cloo ) T D l cloo ] and —X 1 in definition 5.1.1, an initial set T f ° can be cho- 
sen such that the cost functions are numerically well defined and have reasonable 
values in their gradients. Starting with Tj a numerical optimization is performed 
to minimize the corresponding cost functions in an attempt to solve all the relevant 
constraints. After the optimization has converged for Tj , the individual elements in 
Tj are increased to form Tj and the optimization process is continued. This process 
is repeated until all the relevant constraints are satisfied. 

Definition 5.1.1 only states a set of constraints and their functional representation 
in terms of a scalar cost function. Hence the problem formulation leads in general 
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a multi-objective optimization problem. This remaining question is how to solve 
the underlying optimization problem at the k th iteration. One can usually pose the 
problem as a constrained minimization problem by choosing one of the constraint cost 
functions in definition 5.1.1 as the cost to be minimized, say f\ F j c OF (Co, A" 1 , 7 1 , t l f X ), 
subject to the remaining constraints in definition 5 . 1 . 1 . Alternatively one can form a 
single cost function equal to the sum of all the relevant constraint cost functions over 
all the plant conditions and define an unconstrained optimization problem based on 
this single cost function. This latter approach has been adopted in this work. 

Before this numerical approach is presented in more detail, it is important to 
analyze the individual cost functions in terms of continuity, minimally necessary 
number of optimization variables, existence of local minima and so forth. Particularly 
important in this analysis is the assurance that the overall gradients are truly zero 
only if the desired constraints are satisfied. Using an optimization strategy based on 
increasing elements in 7}, these issues will be explored in more detail in the following 
sections. 

5.2.2 Continuity of the Constraint Cost Functions 

Continuity and smoothness of the cost functions are important for the convergence 
of gradient-based optimization methods. It is clear that R l and -X 1 are continuous 
matrix functions in the design variabless Co and X 1 . Given any finite- valued set 7/, 
this implies that f\){C 0 ) 7 b^/ 2 ) anc ^ 3 ) are a l 80 continuous for all the design 

plant conditions and design parameters. The matrix function ARP C OF (C 0 ^ X\ 7 *) on 
the other hand becomes discontinuous in the controller parameters Co at values where 
1^*1 = 0, that is at points where a singular value of D l cl oo equals 7 *. This is due to 
the fact that the inverse of R l appears in the matrix expression ARP C OF (Co, X\ 7 *). 
The occurrence of such parameter combinations has to be avoided throughout the 
optimization or else the gradient-based search would become ill-conditioned. Hence 
in the following two different types of constraints have to be considered: 


Continuity constraints: R l > 0 for i = 1,2, ..n p . These constraints have to be 
satisfied throughout the optimization. In particular an initial controller guess 
has to satisfy all of these constraints before the optimization process can be 
started. 
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•2- Necessary constraints for the Ttop— bounds: All the other constraints and their 
functional representation in definition 5.1.1, i.e. X' > 0 and ARIf OF {C 0 , X' ,7') 
< 0. These constraints may be violated in intermediate phases of the optimiza- 
tion. 

In section 5.3 it will be shown how these constraints are actually enforced in a 
practical optimization. Note, however, that such continuity problems can be avoided 
if block structured LMI-characterizations such as (2.28) or (2.29) are chosen to rep- 
resent the Tfoo-constraints. In these representations the terms R l do not appear as 
inverses. However, these representations will require a larger computational effort 
as the matrix exponentials that have to be computed in the function and gradient 
computations are of larger dimensions. 


5.2.3 The Symmetry Requirement for X' and the Number of Optimization Variables 

The number of optimization variables n cou associated with the controller parametriza- 
tion Co is fixed by the choice of the controller structure and order. If n x < is the order 
of the i 1 * 1 plant, and n c is the specified controller order, then due to the symmetry 
requirement for X 1 we clearly do not have to use (n x . + n c ) 2 optimization variables 
to represent X x in the optimization process. I11 general one can define a set of upper 
triangular matrices X\ (i = 1,2, ...,n p ) as actual optimization variables with 


X 1 


*i.I 

X\a 

X\, 3 . 

yi 

* ^ 1 '( n x l +n c — 1 ) 

yi 

+n c ) 

0 


■ 

yi 

* yi 2 ,(n ii +nc-l) 

yi 

2 ,(n x , +n c ) 

0 

0 

■ 

yi 

* ^3 t (n a i+n c -l) 

yi 

^3,(n^+n c ) 

0 

0 

0 

t 

1 

+ 

1 

yi 

/Y (\. +7i c -l),(n x i+7i c ) 

0 

0 

0 

. 0 

Vi 

(n x , +7i f ),(n jt +?i r ) 


(5.13) 


which requires only 

n ’x = 2 ^- nx ' Uc )( n *' + n c + 0 (5.14) 

design variables per plant condition to represent X 1 . The desired symmetric, solution 
X 1 for ARR C OF (Co, X\ Y) is formed from X 1 as follows: X' = X 1 +(X') T — diag[X x \, 
where the additional term diag[X l \ is introduced for technical reasons to conform with 
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the notational convention for function gradient computations with respect to sym- 
metric matrices (see appendix A). Gradients with respect to X 1 are easily computed 
from the gradients with respect to X x in appendix A. If X x is factorized in this way, 
it is immediate that X x = (X x ) T , but X 1 > 0 is not necessarily satisfied. 

An alternative factorization of X 1 in terms of X 1 that explicitly imposes both 
symmetry and positive semi definiteness of X x (X 1 > 0), can be defined by consider- 
ing X x as a Cholesky factor of X 1 . That is, X x = (X Z ) T X X 1 which is symmetric and 
positive semi-definite for any X 1 . Strict positive definiteness can be incorporated 
by adding e x x I to this expression for a set of small positive e l x ( i = 1,2 , to 

form X x = e x x I + (X X ) T X x which is guaranteed to be positive definite and symmet- 
ric. Note that under this factorization the constraint 4 in definition 5.1.1 would no 
longer be required. Moreover, gradients of all the cost functions with respect to X x 
can also be derived from the results with respect to X x as shown in appendix B. For 
x 1 = (X') T X\ gradients of f , AR i COF {C 0 ,X\'y , ,t i fl ) and P x {X\t) 3 ) with respect to 
X x are 


W = 2 * (5 - 15) 




dX i 


dx* 


(5.16) 


Clearly, gradient expressions for the actual optimization variable X x can be easily 
obtained from the original gradients with respect to X 1 . 

Although the constraint X 1 > 0 need not necessarily be imposed if X 1 = e\I + 
{X') T X\ it is immediate from (5.15) and (5.16) that X' = 0 would be a sufficient 
condition for all partial gradients with respect to X' to vanish. If with X 1 = 0 the 
gradients with respect to Co also vanish, then the optimization will be “stuck” in a 
local minimum that does not necessarily satisfy the inequality constraints necessary 
for the 'Woe-constraints. Even when the gradients with respect to Co are not zero, 
this case may lead to numerically ill-conditioned situations where the Co-gradients 
are large in comparison to those with respect to X' . Numerical experimentation has 
shown that these cases can indeed occur. Hence, for numerical reasons it is necessary 
to impose the constraint X * > 0 for the case where X 1 = (X') T X' and thus the two 
parametrizations are deemed equivalent. 
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In the following discussion we do not necessarily use the representation of X ' in terms 
of X\ as this does not alter the conclusions and would significantly complicate the 
overall discussion. When a particular form of X* is considered, then this will he 
stated explicitly. It should be kept in mind, however, that the actual optimization 
is performed over a set of n p upper triangular matrices X‘ as above and hence the 
overall number n var of optimization variables is 

J 1l P 

n V ar = n con -)- - y^jn x . + n c )(n x , + n c + 1 ). ( 6 . 17 ) 

^ j=l 

5.2.4 Analysis of the Gradient Expressions 

Gradients for the cost functions in definition 5.1.1 have been derived in appendix 
B, using matrix results presented in appendix A. In chapter 4 it has been shown 
that, in the limit as 7} — > oo, the cost functions and their corresponding gradients 
will be zero if the corresponding inequality constraints in definition 5.1.1 are satis- 
fied. It is well known that there is an infinite number of possible controllers for the 
suboptimal 7~Go-prob]em - if such a solution exists. In numerical terms this implies 
that there is an infinite number of controllers Cq and solutions X % (z = 1 , 2, ..., n p ) 
that satisfy the constraints in definition 5.1.1. It is precisely this reason that makes 
the formulation of the Hoo~problem in terms of ARTs so attractive for the mixed 
'H 2 /7~too -problem. The non-uniqueness of the suboptimal 7Yoo - controllers can be uti- 
lized to satisfy additional constraints or - as in this work - to minimize the T^-norm 
or other performance measure of some -possibly different - systems. Regardless of 
how the optimization problem is presented to a nonlinear optimizer, a set of possi- 
ble solutions that satisfy the necessary constraints, would represent acceptable “local 
minima’ 1 for the suboptimal 7ioo~control problem. 

Note that it may be possible that all the partial gradients vanish while at the 
same time one or more inequality constraints are still being violated, i.e. undesirable 
“local minima” that do not satisfy the design goal. In general these situations have 
to be avoided. This concern is examined here in more detail based on the gradient 
information. With the proposed iterative algorithm, the analysis of these expressions 
is restricted to a fixed set 7}. Furthermore, only the i th plant condition will be 
considered since the same conclusions and discussion would apply to all the other 
plant conditions as well. 
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The gradients of the cost functions (5.5) and (5.6) are well behaved and become zero if 
and only if the corresponding constraints in (5.3) are satisfied. Numerical difficulties, 
however, have been encountered and are usually related to the cost function associated 
with the ARI-constraint in (5.4). This will be examined in the following section. 

Assume the parametrization of X 1 to be X 1 = X % + {X l ) T — diag[X% Without 
loss of generality we examine the gradients with respect to X 1 since in this case the 
partial gradients with respect to X 1 are zero if and only if the gradients with respect 
to X 2 vanish. In this case the partial gradients of 


f*Rl cor (C 0 ,X\-i\t<) . Trace 


with respect to Cq and X 1 for the i th plant condition have been derived in appendix 
B and are as follows. 


dr 


ARIg.of 


(Co, X', 7 ', Vj x ) 
dC 0 


df' A 


ARIc,qf 


(C 0 ,X\Y,t‘„) 


dX' 


+ ti-, 2 (RT'(PL,) T ]E\ R , cor 

\x‘B‘, + ((c;, i0O ) T + PH#r\ir ct/x ) T )b y} r 

(5.18) 


?„{E' AR , c . or + bLx‘) t 

+(^ + « , _*')S‘m„,) (5.19) 


with 


ARI' C ' OF (Co,X\Y) 

= (K„,) T X' + X'A‘ aux + X‘Bi u ,X‘ + C[ u , 

(5.20) 


= (Y) 2 i j t d‘ Ao „ 

(5.21) 

S' 

= - DU,M, X ) T 

(5.22) 

A 2 

^ aux 


(5.23) 

D2 

D aux 


(5.24) 

C' 

aux 


(5.25) 

Kux 

= X‘B‘ diX + (C‘,J T D‘, i00 

(5.26) 

E ARI c ,of 

_ e ARI(. e)r (C„.X',-, <)eji 

(5.27) 


Note at this point that both expressions (5.18) and (5.19) contain one common ma- 
trix, namely t % fiE t ARIcQF . Furthermore, this matrix enters both expressions multi- 
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plicatively such that 




ac 0 


= 0 


and 


SJaric OJ ,( c 'o,X',V,t) 1 ) 


ax- 


= 0 


if t)\E l ARi c ,oF = Applying the limiting argument in chapter 4 (see (4.36 - (4.38)) 
to this matrix expression, it can be verified that all partial gradients are indeed 
zero in the limit as tj j — * oo, if the i th ARI-constraint ARI' C iOF {C\X\Y) < 0 
is satisfied. These solutions are therefore acceptable. Possible non-acceptable local 
minima satisfying 


with 


df'ARi c , OF (C 0 ,*% 7 %*}i) 
dC o 

df'ARi c . OP (Co,X i , 1 i ,t i fl ) 

dX i 


0 

0 


ARI' c<OF (Co,X\y) it 0 

are the topic of the following analysis. 

Let us assume that the inequality ARP c of (C 0 , X' , 7 *) < 0 is violated in at least 
one mode. First note that E\ Rlc QF is a positive definite matrix for any finite t'^ and 
ARIc,of(Co, X\Y). In this case sufficient conditions for all the partial gradients to 
be zero are found from (5.18) and (5.19) and are as follows. 

+ B 'a« x X' = 0, (5.28) 

and 

either 


or 




x‘b - 3 + {(c' d: j T + pLm-'m^) T ]D‘ i3 = 


(5.29) 


0 . 


(5.30) 
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Here (5.28) causes — — = 0 and (5.29) or (5.30) are sufficient con- 


ditions for 




J C 1 OF 




ac 0 


= 0. These equations immediately identify solutions 


that have to be avoided. If either (5.28) and (5.29) or (5.28) and (5.30) are satisfied 
then all respective gradients are zero and the algorithm is “stuck” at this particular 
point. Note that the gradients will remain zero even as t l j x is increased. Hence the 
iterative optimization procedure breaks down and will not converge. 

For the general dynamic output-feedback case, X' will have the following structure 


X' = 



(5.3i ; 


where the individual blocks of X x are assumed to be of dimensions compatible to 
the internal block structure of the relevant closed loop matrices (see (3.17) - (3.18)). 
Utilizing this internal structure of X’ it can be shown after some tedious algebra that 
the partial gradients with respect to Co can be zero only if X 22 = 0. However, this 
would violate the assumption that X' is positive definite and hence the constraint 3 
in definition 5.1.1. This fact follows immediately from the Sc.hur complement formula 
(see appendix A). Thus, for the general dynamic output-feedback case with X' > 0, 
the overall gradients with respect to C 0 will be zero only if the i th ARI-constraint is 
satisfied. This is not necessarily true for the static output-feedback case where X' 
reduces to X* = X\ x . In this case there may be Co and X' such that (5.29) or (5.30) 
are satisfied. 

The partial gradients with respect to X 1 on the other hand may be zero regardless 
of the considered case. Possible solutions for A\ ux + B[ ux X' = 0 can be defined in 
terms of the Moore Penrose inverse of B l aux as follows (see e.g. [67]). 


4™* + = o <=► x< = (a-) t = -(fi;„) + /iL + [/ - (b^j+bLJZ' (5.32) 


for an arbitrary matrix Z l of compatible dimensions. 

Although in a numerical implementation this case will not occur exactly, numerical 
experimentation has shown that these situations typically lead to slow convergence 
and numerically small X’-gradients in comparison to those associated with Co- To 
gain additional insight into this situation let us assume that, during an optimization, 
the following case has occurred. The inequality ARI' cof (C 0 , X\ 7’) < 0 is violated 



in at least one mode, A d and A' aux are both asymptotically stable, R' > 0 and X* > 0 
such that A l aux + B l aux X l = 0 for a given controller C 0 . With X 1 > 0 the expression 
A\ ux "h B'auxX 1 = 0 is equivalent to the following identities. 

X'A^ + X'B'^X' = 0 (5.33) 

Ku*{XT X + B[ ux = 0. (5.34) 

Note that (5.33) and (5.34) are also true for the respective transposes. Substituting 
(5.34) into (2.35) in theorem 2.2.1 yields 

[(.V)-' - m(K„,) T + AU(X')-' - iu + = 0 (5.35) 

where L c solves 

KiKu X ) T + KuxK + B' aux = 0. (5.36) 

With A' aux asymptotically stable and B' aux > 0 this implies that [(V*) -1 — L' c ) > 0 
(see statement 6 in theorem 2.2.1) for ARP C ,of(^ o, X\^ X ) < 0 is not violated. A 
similar argument shows that requirement 5 in theorem 2.2.1 is satisfied as well. 

By subtracting (5.33) and its transpose (both are assumed to be zero) from equa- 
tion (2.33) in theorem 2.2.1 it can be shown that for A x aux -\- B x aux X x — 0 the following 
identity is valid. 


< 4) T (4 - **] + 14 - * 4 ^ + <4 


X‘BLX‘ - P^flT'iPLf = 0 ( 5 . 37 ) 


where L* solves 


(A if K + VA, + (Ci,) T Ci, = 0. (5.38) 

Using a standard Lyapunov argument with the assumption that A l cl is asymptotically 
stable, we cannot conclude that L l 0 — X l < 0 as required in theorem 2.2.1. Whether or 
not this constraint is satisfied, will depend on whether the matrix (7* ,. — X' B' X' — 
(Paux) T * n (5.37) is negative definite or not. From the given information 
one is not able to confirm this property. In general this implies that X x may be “too 
small” when A\ ux + B x aux X x = 0 and thereby could violate the necessary condition 
X x > L x 0 (see theorem 2.2.1) for AR1 X C iOF (c o ,v% 7 0 < 0. Similar conclusions can 
be drawn for the cases when A l d and/or A* aux are not asymptotically stable. An 
analogous analysis of the alternative form of ARI' C ' OF {Co,X\y) in (2.32) suggests 
that X x may be “too large”. 
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The above observations give rise to possible additional constraints to better condition 
the numerical optimization scheme. Such additional constraints could be 

lim Trace{e\ L '°- x ' ]t 'f<} = 0 ( 5 . 39 ) 

lim Trace{e^ c ~^ x ^ l ^/ 5 } = 0 (5.40) 

t l fs ^oo 

where L l c and L l 0 solve (5.36) and (5.38) respectively, subject to the additional stability 
constraints on A l cl and A x aux . Gradient expressions for these functions and the stability 
constraints can be derived using the formalism presented in appendix A for functions 
involving grammians and eigenvalue constraints. The stability constraint can also be 
imposed via a Lyapunov-type inequality and cost functions such as (4.13) or (4.15). 
Such additional constraints have been tested numerically and have been found to 
improve the overall performance of the algorithm. However, no analytical proof has 
been found to show that these constraints are sufficient conditions for A l aux -\- B l aux X 1 ^ 
0 and hence cannot in general resolve the gradient-related problem discussed above. 

In summary, there are possible situations where all partial gradients become zero 
without the relevant constraints being satisfied. In this case, the iterative algorithm 
proposed above will fail to converge to a solution that satisfies the desired 
constraints. The possible occurrence of such situations is independent of the par- 
ticular realization of X\ The only identifiable violations of necessary conditions for 
ARI x cof {Co^ X\ Y) < 0 are given by the fact that X x may be “too small”, violating 
condition 3 in theorem 2.2.1 or “too large”. Additional constraints such as (5.39) 
or (5.40) have improved the numerical behavior of the problem but do not in gen- 
eral guarantee that all the respective partial gradients are non-zero when the set Tj 
is updated in the iterative scheme. It is suspected that there are analytical inter- 
relations between the system assumptions in [24] and [113] and the corresponding 
necessary conditions for “local minima” as discussed above. However, without any 
further assumptions on the sign-definiteness of ARP c of (C 0 , X\ 7 1 ) no theoretical 
basis has been found for this conjecture. Future research will have to show if such 
interconnections exist. In short, the formulation for the suboptimal Hoc-controller 
design in definition 5.1.1, when solved via parameter optimization methods, may not 
deliver the desired results, and modifications have to be made to account for these 


cases. 
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Considering the above iterative algorithm, any possible modification needs to satisfy 
the following criteria. Assume that a solution has been found such that, for a given set 
7} the cost functions in definition 5.1.1 are minimized and their respective gradients 
are zero. If one or more inequality constraints are not satisfied, then the corresponding 
partial gradients with respect to at least Cq or X' must be non-zero as the elements 
of T f are increased. This requirement ensures that the iterative algorithm outlined 
above, will converge to a desired solution that satisfies all the 'Hoo-constraints and 
eliminates local minima that do not satisfy these constraints. In the following, various 
perturbation approaches are presented to address this problem. 

From chapter 2 it is known that whenever the i itl Woo-constraint is satisfied, then 
there is a X x such that ARP cof (Co, X\ y) < 0 and A l aux + B x aux X l is stable. Hence 
an obvious choice for a possible modification is to impose the additional constraints 

iKux + Bi^X') Y' + Y'[A' aux + B' aux X'\ T < 0 (5.41) 

Y' = {Y') t > 0 (5.42) 

for a set of n p matrices Y of compatible dimensions to directly impose stability of 
A'aux + B l a ux X’ for all the plant conditions. This would imply that the gradients 
with respect to X * will not be zero after a 7} update. However, this approach will 
require an additional set of ^(n^.. + n c )(n x , + n c + 1) optimization variables per plant 
condition. In general these stability constraints can be represented by constraint 
functions defined directly in terms of the eigenvalues of A l aux + B' aux X l as in (4.13) or 
(4.15). Such a formulation would not require additional optimization variables but is 
in general not differentiable for non-symmetric matrices such as A l aux 4- B l aux X l . 

Alternatively one can solve the so-called “^-shifted 7-Co-problem” (see e.g. [13]) 
by introducing n p scalar perturbation parameters > 0 for which the following 
modified ARI-constraints with cost functions in definition 5.1.1 are formulated for 

i 1, 2, Up. 


ARr c ,oF(Co,X\Y,C) 

ARI' C 'Of(Co,X\Y,C) 


< 0 (5.43) 

:= KKusV + CI}X' + ^[4 + CV] + X'B' aux X' + C' aux . 


(5.44) 



76 


Note that for ( l = 0 the original Wx>~problem is recovered. This modified problem 
imposes the additional constraints that all the eigenvalues of A l cl have real parts 
smaller than —Q. Gradients of the corresponding cost functions 


f’ARl c , ar (C = Trace (5.45) 


are easily found by a substituting 


Ku X -> + Cl (5.46) 

in the gradient expressions for the cost function (5.4). These (' can be used to take 
possible occurrences of A l aux + B' aux X' = 0 into account which now read A' aux + 

+ B l aux X l = 0 for the new cost function. Starting with an inti tial set i = 
1 , 2 , ..., n p , after each iteration and update of 7}, (’ can be adjusted so as to make 
^auxAC I + B' aux X l 7 ^ 0 . Typically one would start out with a prespecified value for all 
the Ci say 1 , which is reduced as tfy, increases. In the limit, as fy, — ► oo the original, 
unconstrained Wx, -problem is solved using such an update rule. In this case the over- 
all gradients with respect to X' will be zero if and only if ARP C OF (C 0 , X',y , (') < 0 
which implies that the desired Woo “Constraint and the additional eigenvalue constraint 
on A l cl are satisfied. This formulation has worked well in the numerical implemen- 
tation but has a drawback in so far as there may be situations where the partial 
gradients with respect to Co may still be zero while the partial gradients with respect 
to X t are large. 

Another modification to circumvent the problem of local minima is to use an 
auxiliary cost and a set of perturbation parameters. Consider the modified cost 
functions f i ARIcoF {C 0 ,X i ^\t i n ) as follows. 


f\R lc , OF (c 0 ,x\Y,t l n ) 


.(Co, X\ 1 \4j) + diA{t),){Trace[{X') T X' + (C 0 ) T C 0 ]} (5.47) 



c‘ 


< 



if 0 < t), < 1 
if 1 < t), 


(4i)“, 0 < k < 1 


(5.48) 

(5.49) 
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for i — 1,2, ...,n p . A typical value for k is k = 0.5 and hence c' < With 

c ' 5 ; 0 < k < 1 it follows immediately that 


0 < lim < 

lim 

(‘hr 

(5.50) 


1 —*oo 

< 

lim 

1 

(5.51) 




< 

0 


(5.52) 


as 1 — k > 0 for i = 1,2, ...,n p . Hence it follows that 


/W. OP (Co,-v,7',4i) = A«w(G..* i ,7 i 4,). 

t^-oOO 


;5.53) 


Thus in the limit as Vj j — ► oo, the original cost functions are recovered. Note that 
the problem formulation in definition 5.1.1 does not take into account the possi- 
ble occurrence of unbounded ( 7 0 and X\ One desirable side effect of the above 
modification is that for any finite t l fl the cost f' ARIc OF {C 0 , X\ 7 *, tC) will be fi- 
nite if and only if Co and X x are finite. Hence finiteness requirements on Co and 
X 1 are directly incorporated into the cost function. Moreover, it is well known 
that the auxiliary term 7Yace[(A' , ’) T A ' 1 + (C 0 ) r C Q ] is convex in C 0 and X 1 (see 
lemma A. 1 . 6 ) and hence possible convexity properties of the original problem are 
maintained as the sum of convex functions is convex. The scalars c ! allow the 
weighting of c i C(t i n ){Trace[(X t ) T X t +{C 0 ) T Co}} such that f' ARIcoF {C 0 , X’, 7 *, V fl ) > 
c ' t ' t {t i f [ ){Trace\{X t ) T X 1 + (Co) r Co]}. Let us now analyze how these additional 
terms alter the gradient expressions. The gradient expressions for the auxiliary cost 
Trace\{X x ) T X 1 + (Co) T C 0 \ are well known and the overall gradients for the new cost 
function f ARIc OF {C 0 , X\ 7 % t l fl ) are as follows. 


»fi*, w ,{Co,xws„) ar AHIcoF (c 0 ,x\Y,th) . „ . .. ... 

gx, ~ gx, + 2cv{t„)X (5.54) 


af\ K , c , OF (c 0l x-,Y,t‘ n ) df ARhor (c 0 ,x\-,‘,f„) „ , „ 

0C o dC 0 + 2c . (5.55) 

With (5.18) and (5.19), necessary conditions for " F ' : — ■ — = 0 and 
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ej^ OF (Co,x',y,t' fl ) 


ax> 


= 0 are as follows. 


+ P«(#)-'(PL,) T }B! UUei0r 
x[ x‘Bi + ((c‘f + p'^irrr'tD 


(5.56) 


c/,oo 


) T )^ 23 ]} T + 2c i i/(t) l )C o = 0 


and 


t'lA&ARIc.oM\** + 3Lr*T + + ^^)^«/ c . OF } + 2 c'v'(t),)X' = 0. 

(5.57) 


Now, for any finite t) u = 0 , a ^c , OF ^' = g and > 0 

it immediately follows that 


(A l aux + BauxX') is asymptotically stable (5.58) 

(ML + BL*' I / 0) (5.59) 

Ci + DURr'IPLf # 0 (5.60) 

+ l(0j«) T + >4 0- (5.61) 

Note that this formulation implies asymptotic stability of A 1 + B 1 X ’. However, 

with the results in chapter 2 (see corollary 2.2.1), it is known that, if a controller 
satisfies the i th Woo -constraint, then there will always be a X * that satisfies this addi- 
tional requirement and hence this formulation does not represent a loss of generality. 
Most importantly equations (5.58) - (5.61) imply that if the partial gradients are zero 
for a given Vj A but the corresponding ARI-constraint is violated, a change in will 
result in non-zero partial gradients for both, C 0 and X 1 . This in turn implies that 
an iterative scheme that minimizes the cost functions iteratively based on a strictly 
monotonically increasing sequence V ^ will not converge to local minima that do not 
satisfy the desired TYoc -constraints, and hence the likely occurrence of such local min- 
ima is eliminated. Thus, for a large but finite the gradients of the modified cost 
function will be zero if and only if all the constraints are satisfied. Furthermore, this 
scheme requires only a minor modification of the cost functions in definition 5.1.1, 
and has worked well numerically. 

Some final comments on the numerical schemes are in order. Numerical simulation 
has shown that direct stability constraints on A l aux + B l aux X l in combination with 
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the other perturbation methods is efficient. However, the additional optimization 
variables required to enforce these constraint in terms of a Lyapunov inequalities may 
be considerable and therefore numerically harder to tackle. All the above schemes 
either require additional optimization variables or involve a perturbation scheme. 
Ideally one would like to have a scheme in which zero gradients directly imply that all 
the constraints are satisfied for any finite set 7y. At the same time this property should 
be accomplished without the introduction of additional optimization variables so as 
to not slow down the overall numerical computations. In general the various forms for 
the ARI-constraints such as ( 2 . 22 ) - (2.24), (X')"' ARIc,of{Cq, X\ 7 t )(X 1 )" 1 < 0 or 
their LMI-representations as well as other alternative ways to enforce X 1 > 0 (for 
example (A 1 ) -1 > 0 ) may provide possible alternative modifications or additional 
constraints to arrive at a numerically effective scheme. Research along these lines 
should be pursued in the future. 

5.3 Numerical Approaches and a Penalty/ Barrier Function Approach to the Multi- 
Plant Hoo -Design Problem 

In this section all the above results and the proposed iterative scheme to solve the 
Woo-design problem are combined into one computational framework. In particular 
a penalty/barrier function approach is presented to solve the general multi plant 
suboptimal 'Woo-design problem. 

Due to the iterative nature of the proposed algorithm the problem can be solved 
by a sequence of constrained optimization problems. In this case one selects one of 
the cost functions in definition 5.1.1, e.g. f\ RIc OF (Co, X' , 7 1 , t l fl ) as actual cost to be 
minimized while all the other inequality constraints are enforced as constraints in a 
gradient-based optimization. If the underlying inequality constraints are not convex, 
one may want to redefine the inequality constraints in definition 5 . 1.1 in terms of cost 
functions such as in (4.13) or (4.15); namely in terms of the eigenvalues of the matrix 
expressions. As mentioned before, these types of cost functions are differentiable as 
long as the corresponding inequality constraint is symmetric. Gradients are readily 
derived from the gradients for the trace type cost function (see appendices A and B). 
This type of cost function has the advantage that it will be zero if the corresponding 
constraint is satisfied independent of a scaling factor tj. Using a penalty cost function 
to represent the constraints in definition 5 . 1 . 1 , this is true only in the limit as the 
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corresponding iyi( 2 , 3 ) 00 • This is not desirable if the optimization problems are 

solved via constrained minimizations as in this case constraints may be defined only 
as scalar inequality or equality constraints requiring an exact upper (lower) bound for 
the inequality constraints. For finite */l(2,3) the exact function value of the individual 
cost functions is not known exactly even if the inequality constraint is satisfied and 
hence constant upper bounds for the cost functions (and hence the constraints) may 
not be defined. 


Consider for example the cost function f AR j c QF (Co, X\ 7% £y x ). The only knowl- 
edge we have is that 0 < Pari c OF (Co, X\Y->Pf\) < n x , + n c (see chapter 2 ) if the 
constraint ARP cof (C 0 , X\ 7 *) < 0 is satisfied. However, if ARP cof (C 0 , X\ 7 *) < 0 
is satisfied, then all eigenvalues of ARP C of (Cq, X\ Y) are negative real and hence 
there exists a large but finite t* fl such that f l ARIc OF {C 0 , X\^\ t l fl ) < 1 . Thus, for the 
solution of the optimization problem via constrained minimizations, the defined cost 
functions in definition 5.1.1 can be utilized as scalar inequality constraints as follows. 


/W„(Co.A-',7',i},) < 1 (5.62) 

< 1 (5.63) 

A(X\tU) < 1 (5.64) 


for any set 7}. If these constraints are satisfied for i = 1,2, ..n p , then all the related 
inequality constraints are also satisfied. 

In this work an alternative route has been chosen to solve the Tf^-design problem 
utilizing the cost functions defined in definition 5.1.1. Instead of solving a constrained 
optimization problem for each T/, an overall cost function Joo{C 0 ,X, Q, 7}) is defined 
that includes all the individual penalty functions in definition 5.1.1. Namely 


Joo{Co,X,G,T f ) = 


1 = 1 


/W^toh-KW/,) 

+ c i i''(i'f l ){Tr<ice\(X'j r X i + (C„) T C„)} 

+ TniV (5.65) 

+ fx(X\t%) ] 


where the individual cost functions, the sets A, Q and 7 } and the scalars c. ' and 
i) have been defined previously. The dependence of Joo(C Q , A, £/, Tj) on these 
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scalars has been omitted in this notation. They will in general be constants during 
the optimization process as described below. It is easily verified that Joo(C 0 , <V, Q, Tj) 
has the same properties as the individual cost functions in definition 5.1.1. That is, 
a controller Cq and a set X satisfy all the essential constraints if and only if 

lim Joo{C 0 ,X,g,T f ) = 0 (5.66) 

Tf—*°° 

and hence 

r lim o J 00 ((7o,^,^T / ) = 0 ^ fc(<7 0 )|| 00 < y. (5.67) 

On the other hand, if one of the constraints is not satisfied, then in the limit as 
Tf — > oo, the overall cost function Joo(Co, X, G, Tf) will become unbounded. With 
this new cost function, an unconstrained optimization problem for the multi-plant 
suboptimal TYoo-problem can be defined as follows. 

Definition 5.3.1 

Consider n p closed loop plant conditions as in (5.1) satisfying the assumptions A l 
through AJ f . Then the Hoo- design problem for the multi-plant output-feedback case in 
terms of Joo(Co, X, Q, Tf) is as follows. Given the set Q of user-specified Tt^-bounds, 
find a controller Cq and a set of matrices X* that solve the following minimization 
problem 

min J oo ( Cq , X, Q , T f ) (5.68) 

O CM A 

iteratively for monotonically mcreasing values t l j k (k = 1,2,3, i = 1,2 ,...,n p ) in Tf 
such that 

lim JocfC*, X*, g , Tf) = 0. (5.69) 

if — *-oo 

Hence the design problem is solved via a series of unconstrained optimization prob- 
lems. Once the optimization (5.68) has converged for a fixed (Tj) k at the k tfl iteration 
step, the elements of (Tj) k are increased to form a set (7})* +1 for which the optimiza- 
tion (5.68) is repeated and so forth. This iteration continues until all the constraints 
have been satisfied. If the specified 'Wco-bounds are chosen too tight, then the al- 
gorithm will terminate at some iteration because no sufficient decrease in the cost 
function can be achieved in this iteration. Specific rules for updating the set (Tj) k as 
well as the role of the scalars c x and v x {t X ff) in this formulation along with a possible 
choice of initial guesses for the controller Co and the set X are discussed next. 
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5.3.1 Initial Guesses, Initialization and Iteration Update Rules 

Good initial guesses are vital for any nonlinear optimization problem. For this prob- 
lem, numerical simulations have shown that an ^-optimal controller for the closed 
loop system £^, c/ (C 0 ) := has provided a good initial guess - 

if such a controller with the desired structure and order is available. One method to 
find a structurally constrained controller is given in [64]. In [139] some connections be- 
tween such a 7~G-optimal controller and the resulting Tioo norm for the closed-loop 
system have been investigated. Any initial controller guess, however, must satisfy 
( 7 l fl - (Dkoof Dl'n > 0 for i = 1,2,. .n p . As discussed earlier, these constraints 
are necessary for the optimization problem at hand to be continuous in the controller 
parameters and hence have to be satisfied throughout the optimization. If the initial 
controller guess is stabilizing one or more plant conditions, then the corresponding 
initial guesses of X 1 can be determined by X 1 = L l a , where L l 0 solves 

(K,) t L: + L[A' d + (C' d ) T C' d = 0 (8.70) 

which implies that the initial ARI l COF (Co^ X\Y) reduces to 

ARr c , OF (('o,x\y) = pHhT'(pL,) t (“) 

with 

PL = X'B' cLoo + (Q t00 ) r £>: />00 . (5.72) 

If the initial controller guess stabilizes the i th plant and satisfies the i th 7foo _ c°nstraint, 
then a possible initial guess for X 1 is the corresponding ARE-solution that can be 
found with any Ric.cati equation solver. 

If the initial controller guess does not stabilize the i th plant, then any symmetric, 
positive definite matrix X' will suffice. In any event, we will always be able to define 
an initial set X of symmetric positive definite matrices X' . The initial set 7} is 
chosen such that the overall cost function Joo(Co,X,Q,Tj) has a finite value and 
the corresponding partial gradients are well defined. The auxiliary parameters c*, 
i = 1,2, ...,n p in (5.65) are initially set to values such that the sum of the Tfoo-related 
cost functions is larger than the auxiliary cost in Too(C 0 , X,Q,Tj)- The parameter 
k is assumed to be preselected and is constant throughout the optimization process. 



In general this additional parameter has been introduced to assure that the auxiliary 
cost is zero in the limit as 7} — ► oo. 

Now assume that at the k th iteration a controller (Co)* and a set (A')* have 
been found for a given fixed set (7/)* and a set of scalars (c*)*, i — 1,2 , ...,n p such 
that Joo({C 0 ) k ,{X) k ,G,(Tf) k ) is minimized and all partial gradients of the function 
J<x>{{C o)*\ (A')*,C?, ( Tj ) k ) are zero. The question arises how to adjust (7})* (7jr)* +1 

and (c*)* e- ► (c 1 )*" 1 " 1 , i — 1,2, ...,n p such that the problem at the subsequent ( k + l)* /l 
iteration is well defined. Possible update rules for (7})* may in general follow two 
different strategies. Assume that some but not all of the inequality constraints have 
been satisfied at the k th iteration. In a penalty function approach one would then in- 
crease only the elements in (7 })* that correspond to active constraints while elements 
in (7/)* corresponding to non-active constraints would be kept at their old value. In 
such a set up the individual cost functions corresponding to non-active constraints 
would still contribute to the overall cost function J 00 ((C'o) fc+1 , (A')* +1 , Q, (7})* +1 ) in 
the subsequent minimization. At the same time the penalty functions corresponding 
to active constraints become dominating in the overall cost function and the partial 
gradients. Alternatively, in a barrier function approach, one can choose large val- 
ues for elements in (7))* +1 corresponding to non-active constraints. Knowing that 
the individual cost functions and their gradients will be approximately zero for a 
sufficiently large value of the corresponding element in (7))* +1 , this is equivalent to 
a Lagrange multiplier approach in which a non-active constraint is deactivated by 
choosing a small Lagrange multiplier for this specific constraint. In this formulation 
the individual cost functions associated with non-active constraints will effectively 
act as barrier functions rejecting any choice of controllers (( 7 0 )* +1 and (A')* +1 that 
violate these constraints in the subsequent iteration. 


In the following, an update scheme is presented resembling a penalty function 
approach. The adaption of this scheme to a barrier function approach is stated later. 
To keep the notational complexity to a minimum, (;/(^i))*) and will 

be abbreviated by (//)* and (//)* +1 respectively. The following update scheme for 
the i th plant condition is one of many possible approaches one can pursue. Assuming 
that the k th iteration has been completed successfully with a controller (Co)* and a 
set (A')*, the update for the next iteration proceeds as follows. 
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1. Vj-^ -Update: 


• If the i th ARI-constraint is satisfied, let (f) 1 ) A;+1 = {t'f i )* , otherwise let 




A[/tH;j. OF ((C„)\(X‘)‘,7')]' 


(5.73) 


• Set (z/)^ 1 = — r '| x ~ r and find the largest (c l )^ +1 where 0 < (c*) fc+1 < 
[(^/i)* +1 ] K suc ^ that the following conditions are satisfied: 

(X-)\ 7', (<'„ )‘ + ' ) (5.74) 

> 10(c') lt, (^)‘ +, {rrace[[(A r ')‘] , '(A' i )‘'+ [(C 0 ) r ]‘(Co)‘]} 


2. t'j 2 1 J pdate: 


_ f ^/aRIc.of^ 0 ' X 1 1 7% (^/i ) fc+1 ) , ■, 

a \ ’ Qn lc 0 =(C 0 ) fc / 

0 X'=(X‘) k 


> 10 (c , y +1 (i/ < ) fc+1 ff{(C , o)*} 


(5.75) 


and, if 


then 


;w, lco=(Co)0 > 

*■=(*■)* 


(5.76) 


-^/W,oe( C o,^,7%(4i) fc+1 ), 

flV. lc'o=(C 0 )‘ J 

X’=(X‘) k 

> 10 (c t ) A:+1 (//) fc+1 ^{(X , ) A: }. 


(5.77) 


Select (tj 2 ) k+1 > (t % j 2 ) k such that 



10 

|A{[(^) T ^ l00 -(7 i ) 2 /]k=(C.)‘}l 


(5.78) 
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3. Jp-Update: 


If the i th positivity constraint -(A' 1 )* < 0 is violated, let 

(, y‘ + ' = xnWi (5 - 79 > 

or else select (tV 3 ) fc+1 such that 

(c^* + V’)* +1 (**’)* > {t)^) k+A (5.80) 


First note that this scheme guarantees that all elements of 7y are monotonically in- 
creasing functions of the iteration number and do not decrease. The /^-updates 
assures that the ARl-cost functions associated with the active AR I— constraints con- 
tribute more to the overall cost than those corresponding to the non-active con- 
straints. The same is true for the ^-updates when the i th positivity constraint 
— {X l ) k < 0 is violated. The role of the scalars c 1 and // will become more clear by 
the analysis of the gradient expressions. These gradient expressions are readily found 
from the sum of the gradients of the individual cost functions. 


dJoo(Co,X^(T,) k ^) 

dCo lcr 0 =(Cb)* 

X'=(X l ) k 


^,VfAR, c , or (c°,xWAtW'i M \ 

1 ; )/ ' lc 0 =(C , o)’ i 

X’=(X') k 


t=l 


dC o 

, ^(c 0 ,y,(^ 2 ) fc+l ) 

dC 0 

+2(c i ) k+ \,/) k+ \C 0 ) k ] 


lr; 0 =(c 0 ) k 

X'={X') k 


(5.81) 


^ 00 (C , o,.Y,g,(T / )* + 1 ), 

dX i 


\C a =(C 0 ) k ~ 

X'=(X') k 


d f t A*ic.o,( c O’XWAth)*') 

dX l 


ICo=(Co)* 


+ 2{c') k+ \v i ) k+ ' l (X i ) k . 

(5.82) 


The update rules (5.74) - (5.77) assure that (c*) fc+1 (i/’) fc+1 {Trace [[(V , )*] r (V , ) <: + 
((Co) T C 0 ) fc ]} do not overwhelm the other '7f 00 -related cost functions and their re- 
spective gradients. If (J* /3 )* +1 is chosen as indicated, then (c') k+l (i/) h+ '(X , ) k > 


d'Z. - 
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(^/3)* :+le ^ X * and hence at the beginning of the ( k + l) </l iteration the par- 

tial gradients with respect to X % are not zero, even if A\ ux + B‘ aux (X t ) k+x — 0. 
Although the ( k + l) i/l iteration may converge to a parameter combination where 
~(^jr.3) fc+le * ^ 3 * anf l 2(c , )* +1 (i/‘) fe+1 (A r *) fc cancel each other, due to the term 

2(e') fc+1 (t/ t ) fe+1 (Co) fc in the controller gradients the overall gradients force the opti- 
mization to improve on the eigenvalues of ARIc Note that 

one can also enforce X 1 > 0 by the cost function Trace {e“ (xt)_1 ‘/ 3 }. This implies 
that A x aux -\- B l a ux(X l ) k ^ is stable if the combined gradient with respect to X 1 are zero 
after the (k-\- \ ) tfl iteration has been completed. This additional problem is specific to 
the penalty/barrier function approach and is not present if the algorithm is executed 
as a sequence of constrained optimization problems. 

The update rule for the n p scalars (/y 2 )^ +1 is not as obvious and requires some more 
analysis. As discussed earlier, the n p constraints — R l > 0 are necessary constraints for 
the minimization problems to be smooth and hence have to be enforced throughout 
the proposed iterative optimization procedure. Assume that — R l < 0 is satisfied for 
a given fixed controller C 0 and consider the following bounds for f l D (C o, 7*^/2) a!R i 
the maximum singular value of its gradients for the i th plant condition. 


and 


/MCo,7Vy = Trace 

< , v e x <- R 'l‘/= 


ec a 1 


= H^2B32e- R ' l HBci,oo) T D 23 } 

< 2 t) 2 v{Dy 2 }a{D 23 }a{D d<00 } 


(5.83) 

(5.84) 


(5.85) 

(5.86) 


For a fixed controller it is easily verified that the upper bound (5.84) for the cost 
function /b(Co, 7% f^ 2 ) * s a nionotonically decreasing function of Vj 2 (assuming — R‘ < 
0 is satisfied). The upper bound (5.85) for the gradient expressions on the other hand 
exhibits an interesting behavior. It is easily verified, that (5.85) is a nionotonically 
increasing function of t ) 2 for t ' f2 < it has a maximum at t) 2 = - ^ and 

decreases nionotonically for larger values of t) 2 . Graphically this implies that (5.85) 
has a “hump” at t ) 2 = j^r y Selecting (t' f2 ) k+x much larger than in the above 

scheme implies that both the function value of f' D {C 0 , 7*, V J2 ) and its gradients will 
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be small at the beginning of the (A: + \) th iteration and would dominate the overall 
cost function if these constraints are violated during a line search. Numerically the 
above update rule for (*/ 2 )* +1 implies that the cost functions f l D ((C 0 ) k +\y, (*/2)* +1 ) 
will act as barrier functions, effectively enforcing the continuity constraints R l > 0 
during the ( k + l) th iteration. 

As mentioned above, alternative update schemes may be devised. In particular, 
the explicit numerical values chosen for the updates have been derived from numerical 
experimentation utilizing the MATLAB optimization toolbox. The presented scheme 
represents a mixture of penalty and barrier function approaches. For the constraints 
that are allowed to be violated during intermediate phases of the algorithm, the 
above update scheme realizes a penalty function approach. The specific choices for 
( ^/2 )k~^ 1 incorporate a barrier function approach so as to guarantee continuity and 
hence smoothness during the subsequent optimization. 

In general the above update scheme can be easily adopted to an overall barrier 
function approach where not only the continuity constraints are enforced via bar- 
rier function ideas, but all constraint functions corresponding to non-active matrix 
inequalities. If the TCo-constraint and hence the corresponding matrix inequality 
is satisfied at the i t/l plant condition, then one would choose large (/^ 1 )^ +1 , (t l j 2 ) k + } 
and (fy 3 )* +1 for all the penalty functions associated with this Hoo-constraint. With 
such an update procedure all penalty functions associated with the i th Tfoo-constraint 
will act as barrier functions in the (A: + l) th iteration, avoiding possible controllers 
(Co)* +1 and ( X l ) k +1 that would violate any of the non-active constraints. For a more 
detailed discussion of penalty/barrier function approaches the reader is referred to 
[63] which contains an excellent treatment of these methods. 

5.4 A “Top Down ” Approach and the Tin-Optimal Design Problem 

The numerical solution for the multi-plant T^-problem in terms of Joo{C 0 , X, Q , 7», 
starts with initial guesses for the controller Co and X that may not satisfy any of the 
constraints in definition 5.1.1. The n p desired TCo-bounds 7 1 are given a-priori and 
the optimization procedure attempts to satisfy these bounds. With the introduction 
of n p additional optimization variables 7 q and the corresponding set 


= { li il ... iS" } 


(5.87) 
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a “Top Down” approach can be developed as described below. 


Definition 5.4.1 

Consider n v closed-loop plant conditions in (5.1) satisfying the assumptions A1 through 
AJ h the set Go, the extended set 7} = {7), t tf*}, where the set Tj has been 
defined previously, and Joo(Co, A! ,G ,Tj) as given in definition 5.3.1. Then a u Top 
Down ” Hoo-design algorithm for the multi-plant output-feedback case is defined as 
follows. Given the set Q of user-specified Ttoo -bounds, define the following cost func- 
tion 


Joo{Co,X,G,Go,f f ) 


Joo(Co,A\£o,T / ) + 


^ c N) 2 -(7’) 2 ]<^ 

t = 1 


(5.88) 


mid find a controller Cq, 
minimization problem 


a set of matrices X 


min Joo ( C 0 , A ', 


* and a set Qq that solve the following 
G,Go,Tf) (5.89) 


for increasing values of t l fk , (k = 1 , 2 , 3 , i = 1,2 ,...,n p ) and {t)^jj y , ..., in tj 
such that 


Hm ./oo(C*,.r,g,C? 0 *,f / ) = 0. 
Tf->oo 


(5.90) 


Note that in this formulation Joo{Co, A’ ,G 0 ,Tf) defined in (5.65) is not a function 
of the prespecified set Q , but a function of the optimization parameters 7 ^. The 
(user-specified) fixed bounds 7 * appear only in the additional term 

^ e [U)Mv) 2 l<} 7> 

2—1 

This implies that (5.90) is satisfied if and only if 

ARr c , OF (c 0 ,x\y 0 ) < 

-X 1 < 

(lb ) 2 < 

for i — 1,2, ...,n p . This set of inequalities directly implies that 

ll^(C 0 )||L < (7o) 2 

(7o ) 2 < (7 ‘) 2 


(5.91) 


0 

0 

0 

(7 ‘) 2 


(5.92) 

(5.93) 
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and hence all specified Woo -constraints are satisfied if (5.90) is satisfied. Gradient 
expressions for J<x>(Co, X, Goy Tf) with respect to (7 q ) 2 are included in appendix B. 
Note that, without loss of generality, we can optimize over the n p scalars (7o) 2 , as 
all relevant cost functions are functions only of (70) 2 and (Y) 2 and not of 7^ or 
7*. Gradients of the term Xa=i on the other hand are trivial scalar 

gradients. This formulation has a significant advantage over the previous formulation 
in that it allows the definition of “good’ 1 initial guesses if a controller is available that 
stabilizes all plant conditions simultaneously. A possible scheme for choosing the 
initial guesses for C Y o, X and Go and solving the corresponding optimization problem 
to satisfy all desired Woo-c°nstraints can be formulated as follows. 

1. Find any initial controller Co (with the desired structure and order) that simul- 
taneously stabilizes all plant conditions. 

2. For i — 1,2, choose the initial set Go such that 

(7 j) 2 > l|Ti(C„)||L. (5.94) 

3. For this initial set Go and i = 1,2 , ...,n p determine an initial set X from 

oj , 7 q) + el = 0 (5.95) 

for some small e and the fixed initial controller guess Co using a standard Riccati 
solver. 


With these initial settings all but the n p constraints (70) 2 < (7 1 ) 2 are satisfied. Hence 
the iterative optimization to solve this problem will have well defined initial guesses. 
The subsequent iterative minimization process will only have to additionally enforce 
the constraints (5.93). As soon as these constraints are satisfied, the iteration will 
terminate and all Woo-constraints are satisfied. 

This formulation also gives rise to an Woo-optinial design algorithm. Assume 
that all elements in the set G are zero. This implies that the optimization problem 
in definition 5.4.1 attempts to find a controller that guarantees an infinite stability 
radius for every plant condition, i.e. ||7 1 j o (C 0 )||^ o < 0 for i - 1,2, Hence if we 

apply the algorithm in definition 5.4.1 to this problem, the optimization process will 
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try to satisfy all the relevant constraints and additionally minimize the functional 
Y^i = i e ^ tfl which amounts to a minimization of all considered Hoo-norms. This 
is a novel approach to solve the multi-plant 7^oo -optimal design problem, although 
^foo~°ptimal controllers often exhibit many undesirable properties. 


5.5 'Hoo -Design Examples 

All the examples in this section have the following open-loop state-space description. 

*•(<) = ^V(i) + BfrUt) + 

4>(<) = Cfrit) + £>j 2 u4(f) + D' 23 u'(t) (5.96) 

»*(<) = C&it) + D' 32 wUi) + 

That is, all matrices corresponding to possible ^-objectives are assumed to be zero. 
The number of design plant conditions is evident from the superscripts of the corre- 
sponding system matrices. 


5.5.1 Example 1 

The first example considered is taken from [88]. In accordance with the notation in 
(5.96) the open-loop system matrices are as follows. 


( -0.3908 -0.4565 


A 1 = 


1.4453 -1.0491 


^ -0.1288 0.6744 


1.2657 ^ 
-1.2077 , 

1.0324 j 



( 0.0488 ^ 


* -0.4275 ^ 

B\ = 

0.3608 

. = 

-0.4470 


^ 0.3564 j 


v -0.9172 j 

c\ = ( 

'0.9420 0.0144 0.1187 ), 

Cl = { 

-1.5567 

-1.9432 

-0.0914 ) , 


D\ 2 = 0, ^23 - 1-3575, 

D \ 2 = 0.5185, D \ 3 = 0. 


The plant is open-loop unstable and all the relevant subsystems have no invari- 
ant zeros on the ju>-axis. However, the open-loop subsystems ( A, B 2 , 63 , A 32 ) and 
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(A, £?3,r7 2 , D 23 ) have invariant zeros in the right-half plane. The plant also satisfies 
the assumptions imposed in [24] for a regular Tioo-design problem. Hence the two- 
Riccati equation approach to the suboptimal Woo-problem can be used to compute 
the central controller. Utilizing this approach it can be verified that the smallest 
achievable closed-loop 'Woo-norm ||Tj 0 (Co)|| 0 o is approximately 2.1426. Hence it is 
known that for 7 1 < 2.1426 no 7~too-suboptimal controller exists. Using the discussed 
penalty function approach, a controller has been designed that satisfies a specified 
robustness bound. For the design the 7 Yoo“bound 7 1 = 2.2 was chosen, which is 
rather close to the optimally achievable 7Yoo— norm. The controller to be designed is a 
dynamic, strictly proper full-order (third-order) controller. The following controller 
has been obtained. Its state-space realization is given by 


( -69.52247277 


A c = 


-159.84943026 


B c 


-13.99956517 
7.79934347 ^ 
-30.37935405 


4.09046301 

-13.73735121 

-0.63916776 


-132.24247153 ^ 
92.97199999 
-1.78390805 j 


\ -1.63224803 j 

C c = ( -39.68076598 0.62994741 -45.76734663 ) , D c = 0. 


Since the plant satisfies all the requirements for the two-Riccati equation approach, 
the central controller for 7 1 = 2.2 has been computed as well to allow a comparison 
between the designed controller and the central controller. The state-space realization 
of the central controller is as follows. 


>4 C 


B c 

Cc 


f -1.72346585 -1.01231441 -9.35407417 N 

0.42846443 -0.64560199 -6.29074683 , 

i -19.75912227 9.71850563 -45.31150942 j 

' -0.29369100 ^ 

-0.14518215 , 

^ -8.24424158 j 

( 0.75994761 0.05747133 16.36721454 ), D c = 0. 


Some properties for the design and the central controller are summarized in tables 
5.1 and 5.2 respectively. 
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Table 5.1: 7Yoo-design example 1 : Closed-loop properties for the designed controller. 



Table 5.2: W^-design example 1: Closed- loop properties for the central controller. 


Specified 7 1 

2.2 (6.8485 dB) 

Achieved ||T^(Co)||oo: 

2.1991 (6.8449 dB) 

Closed-loop system poles: 

A, = -43.2017 

A 2 = -2.5091 

A 3 , 4 = -0.3991 ± 1.7837 j 

A 5>6 = —0.7895 ± 1 .26 1 8j 

Controller poles: 

A„ = -48.0839 
A c2i3 = 0.2017 ± 2.1338j 
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Both controllers stabilize the system and the achieved closed-loop Tfoo-norms for 
both controllers are almost identical. It can be verified that —0.3991 ± 1.7837j» 
and —0.7895 ± l/2618j are zeros of the open-loop subsystems (^4, Z?2, C3, D 32 ) and 
(A, #3, O2, A23) an< ^ h ence are necessarily poles of the closed-loop system with the 
central controller in the loop (see e.g. [45]). The corresponding closed-loop poles 
for the designed controller, namely —0.3957 ± 1.8170 j and —0.7312 ± 1.1993j are 
close to the zeros of ( A , 5 2 , C 3, D32) and ( A , 5,3, ( 7 2 , D23). However, they are numer- 
ically not exactly equal. This represents a departure from the properties that the 
central controller is bound to exhibit. Both controllers are unstable suggesting that 
there may not be a stable controller that internally stabilizes the system and satisfies 
the specified 'H 00 -bound. Singular value plots for the closed-loop transfer function 
T^(Co, .$) from to ^(.s) for the designed controller and the central controller 

are included in Figures 5.1 and 5.2 respectively. These plots confirm that the specified 
Woo-bound has been satisfied by both controllers. 

In a second design the Hoo ~ bound was chosen to be 7 1 = 2.16. Using the presented 
penalty function approach a controller has been found that satisfies this bound with 

l|ri(Co)|U <2.16. 


Ac 


( 94.72003708 116.54307959 

-66.68926127 -104.71656006 
y -15.73792161 38.51746238 


66.04512426 ^ 
20.54296555 , 

-181.78169890 j 


Be = 


( -153.54027409 \ 
107.75005408 
19.22234533 


C c = ( 0.04202796 -11.19723338 33.22247777 ) , D c = 0. 


The achieved ||7’ < J a (Co)|| 0 o is 2.1579 (6.6806 dB) which is only about 0.01 above the 
optimally achievable ‘H 00 -norm for this example. However, the large matrix entries 
suggest that an optimal TCo-design would require a high-gain controller. 
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5.5.2 Example 2: The Two-Mass Spring System 


The two-mass spring system has been treated extensively in recent publications. 
This plant was for example the benchmark problem of the 1990 American Control 
Conference and references describing and analyzing this plant in detail are plentiful. 
The open-loop system is given by 


i\t) 


4V) 


0 10 0 

— — 0 — 0 

m m 

0 0 0 1 

— 0 — — 0 


x'(t) + 


0 

1 


\ 


w lo(t) + B\u\t) 


m 


) 


( -1 0 1 0 ) x'(f) 


(5.97) 


v'(t) = 


The matrices B\ and CJ are specified later depending on the particular design problem 
under consideration. This system represents the dynamical model of two masses that 
are connected with a spring. In this description both masses are assumed to have 
the same mass m. The parameter k in (5.97) represents the spring constant of the 
spring connecting the two masses. The nominal values for these two parameters are 
m 0 = 1 and A' 0 = 1. The states x\ (t) and xl(t.) represent the position of the first and 
second mass respectively. The states x\{t) and x\(t) are the corresponding velocities 
of the two masses. For this design example it is assumed that both masses assume 
the nominal value m = mo = 1 . With this assumption and the matrices B\ and C\ in 

(5.97) the system description takes into account possible uncertainties in the spring 
constant k. Let the true spring constant k be denoted by k = k 0 + AA- where AA' is 
the perturbation of k around A'o- Then it is easily verified that 



0 

l 

0 

0 

\ 



0 

i 

0 

0 

\ 



0 ^ 


k 

0 

k 

0 




_ bo. 

0 

Al 

0 




1 


m 0 


mo 



— 


mo 

mo 


+ 


m 0 


0 

0 

0 

1 




0 

0 

0 

1 



0 


k 

mo 

0 

k 

m 0 

0 

) 


1 

h . l 
mo 

0 

_ J%L 

7710 

0 

) 



1_ 

in 0 j 


0 1 0 ) 

(5.98) 


and hence 


A' = Al m + fijAtC] 


(5.99) 
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where A\ om is the nominal open-loop system matrix for m = mo = 1 and k — ko — l. 
With the discussion in chapter 2 it can be verified that the uncertainty block A(s) 1 
is identical to Ak; namely A (.s) 1 = A k. Hence the open-loop system for the FLoo~ 
design problem with A k as uncertainty is the system (5.97) at the nominal plant 
condition m = mo = 1 and k = k 0 = 1. For this uncertainty various design cases are 
now examined. The open-loop system is unstable, the suboptimal Woo-problem is 
singular and the subsystem ( A , B 2 , C 3 , D 32 ) has zeros at s = 0 and hence on the juj- 
axis, regardless of the choices for B\ and Thus neither the DGKF-approach nor 
the Stoorvogel approach are applicable to this problem. Depending on the matrices 
B\ and C\ and hence on the information available to the controller and the allowed 
actuation through B \ , three different design situations are considered in the following 
subsections. 

5.5.2. 1 Case 1: Measurements of x\(t), x\(t) and Actuation on the First Mass 

For this design case both mass positions are available to the controller while a force 
may be applied only to the first mass. Hence the corresponding matrices Bl and C\ 
are as follows. 

/ 0 \ 

B\ = 1 

0 

V 0 ) 

For this design case it follows immediately by inspection, that only positive values 
for k can be tolerated. That is, “active” springs (for example an additional force) 
between the two masses is not permissible as we can only act on one of the masses. 
From these considerations it follows immediately that the maximum tolerable AA: 
for k = ko = 1 is given by |AA'| < 1. This implies that ||A(.s) 1 || 00 < 1 and hence 
the optimally achievable 7Y< X , norm of the transfer function TUCq, ,s) from to 

z iL)(- s ) ’ s K(C 0 )|U = 1, which in turn implies that 'K 00 -bounds 7 1 < 1 cannot be 
achieved. For the following controller design an 7-fco -bound 7 1 = 1.0005 has been 
specified. The controller to be designed is a dynamic proper full-order controller 
with structural constraints defined by the controller system matrices below. Using 
the penalty function approach, a controller satisfying these requirements has been 


1 0 0 0 \ 
OOlo) 
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designed. The (structurally constrained) controller realization is as follows. 


A c 


0 

1 

0 

0 

-4.96497865 

-4.81507032 

0 

0 

0 

0 

0 

1 

0 

0 

-8.34902647 

-3.16030032 


B c 


CD 


C c = ( 67.97641069 12.13736699 193.16591187 101.09971272 ), 


D c = ( -69.72761009 32.89950444 ) . 

The singular value plot of the closed-loop transfer function T^(C 0 ,s) from w^s) 
to ^(.s) in Figure 5.3 verifies that the specified 7Yoo“bound is indeed satisfied. The 
designed controller guarantees stability for k G [k 0 - Tofm^o + 775555] aiK ^ h euce 
k G [3 x 10“ 4 , 1.9997]. This in turn implies that uncertainties AA: with |AA:| < 0.9997 
can be tolerated without the closed-loop system becoming unstable. Some closed- 
loop properties are summarized in table 5.3. 


5.5. 2. 2 Case 2: Measurement of x](t) and Actuation on the First Mass 


For this design case only the position of the first mass is available as measurement 
and a control action on the first mass is allowed. The open-loop system matrices B\ 
and C\ are as follows. 


f 0 > 

1 

0 

I 0 / 


C\ = ( 1 0 0 0 ) . 


This design case has equivalent interpretations regarding the minimally achievable 
7^00 -norm of ||T’J(,(C , o)||oo. That is, there is no controller that will satisfy a specified 
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Table 
case 1; 


5.3: Two-mass spring Tioo-design example: Closed-loop properties for design 
Measurements of x}(<), x\(t)\ Actuation on the first mass. 


Nominal design plant: 

m 0 = 1 , k 0 = 1 

Specified 7 1 : 

1.0005 (0.01 dB) ! 

Achieved ||r^(C , 0 )|| oo : 

1.0003 (0.0060 dB) 

Guaranteed stability region: 

3 x 10" 4 < k < 1.9997 

Closed-loop system poles: 

Ai = -0.0001 

A 2 = -0.1670 

A 3 = -1.3018 

A 4 = -3.3323 

A 5 , 6 = -0.7674 ± 8.4148i 

A 7 , 8 = -0.8197 ±2.3065j 

Controller poles: 

A c , = -1.4958 
A c2 = -3.3193 
A c3 ,4 = -1.5802 ± 2.4191 j 
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n 

oo bound ||r^(C7 0 )||oo < 1 . However, this design case differs from the first in that 
it represents a problem with a co-located sensor/actuator pair. Furthermore, as the 
position of the second mass is not available this variable has to be “reconstructed” 
in the controller to guarantee closed-loop stability. The specified Hoo-bound 7 1 for 
the design was set to 7 1 = 1.05. The controller structure was chosen such that 
controllability of the pair ( A c , B c ) is explicitly imposed (see the controller matrices 
below). The selected controller type is a dynamic proper full-order controller. The 
designed controller has a realization with the following state-space matrices. 



-0.04433820 5.66240636 0.44756456 -4.32708050 j \ 1 ) 


Cc =( 0.40013604 -51.10117437 -3.95336090 27.45265681 ) , 

D c = ( -9.02463471 ) 

The closed-loop properties for this design are summarized in table 5 . 4 . The singular 
value plot of the closed-loop system (see Figure 5.4) validates that the specified 'H QO - 
bound 7 1 = 1.05 has been satisfied. The designed controller stabilizes the system and 
guarantees stability for k € [k 0 - 77 ^ 77 , k 0 + 77 ^ 77 ] and hence k £ [0.0398, 1.9602]. 
This in turn implies that uncertainties A k with |AA| < 0.9602 can be tolerated 
without the system becoming unstable. 

5. 5.2. 3 Case 3: Measurements of x\(t), x\(t) and Actuation on Both Masses 

In the last design case for this example let us consider the problem where both 
positions are available as measurements and we can actuate on both masses. The 
open loop system matrices B\ and C\ corresponding to this problem are as follows. 


/ 0 0 \ 



(0 ,) 


10 0 0 
0 0 10 
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Table 5.4: Two-mass spring 7"foG“design example: Closed-loop properties for design 
case 2 ; Measurement of #{(/); Actuation on the first mass. 


Nominal design plant: 

m 0 = 1 , k 0 = 1 

Specified 7 1 : 

1.05 (0.9758 dB) 

Achieved ||ri((7„)||„: 

1.0415 (0.8132 dB) 

Guaranteed stability region: 

0.0398 < k < 1.9602 

Closed-loop system poles: 

A! = -0.0058 

A 2 = -0.0244 

A 3 , 4 = -0.0025 ± 0.0089.7 

As, e = -0.8301 ± 1.8971.7 

A 7i8 = -1.3158 ±0.1923; 

Controller poles: 

A cl = 0.0078 
A c2 = 1.0635 
A c3 = -1.2998 
A c4 = -4.0986 
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This design case is interesting because the minimally achievable of the 

transfer function T^((7 0 ,,s) from ud^.s) to ^(.s) can be smaller than one. Obviously, 
if we can apply a force to both masses and both mass positions are available to 
the controller, then we can always compensate for any force in between these two 
masses (given sufficiently large control forces). This implies that even additional 
forces in between these two masses can be tolerated corresponding to the case of an 
“active” spring. Thus the achievable 7~foo-norm for the transfer function T^(Co,.s) is 
ri(c„)iu = 0 and we can actually guarantee stability for any A k. The controller 
type for this design case is a strictly proper fourth-order controller with structural 
constraints as depicted by the the structure of the controller matrices A c , B c and 
C c below. The resulting controller realization is given by the following state-space 
matrices. 



0 

1 

0 

447.13923701 

-57.63138721 

0 

0 

0 

0 

0 

0 

-35.90942974 




I 6170.60542737 
( -6181.52733530 


10902.36023990 

-10913.54138359 


-1038.25779087 

1038.72400509 


-9074.3254321 1 
9073.20212098 



The designed controller stabilizes the system and guarantees stability for k £ [&o — 
0 0888 ’ *-'0 + 0 0888 1 an< ^ h ence f° r & € [—10.2613, 12.2613] (see table 5.5 and Figure 5.5). 
This implies that uncertainties A k with | AA: | < 11.2613 can be tolerated without loss 
of stability. The lower limit in the bounding interval on k ( k € [—10.2613, 12.2613]) 
on the other hand is negative and indicates that a negative spring constants k within 
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the given boundaries will not cause instability. A negative spring constant, however, 
corresponds to an active element in between the two masses which can be interpreted 
as an additional force in addition to the passive spring between the two masses. 
This result confirms the above analysis on the minimally achievable Ttoo-norm of 
l|7l(G))||oo. Note also that the first row in the controller matrix C c is almost iden- 
tical to the negated second row in C c . This shows that both controls act in opposite 
directions so as to compensate for possible forces between the two masses. Further- 
more, the more negative the acceptable fc, the larger a possible force between these 
masses will be. Hence, for very small values of 7 1 this will generally require high-gain 
controllers and large control efforts. 


Table 5.5: Two-mass spring Woo-design example: Closed-loop properties for design 
case 3; Measurements of ar}(i), x\(t ); Actuation on both masses. 


Nominal design plant: 

ii 

o 

II 

© 

Specified 7 1 : 

0.1 (-20 dB) 

Achieved || 3^, (C'o) ||oo : 

0.0888 (-21.1103 dB) 

Guaranteed stability region: 

-10.2613 <k < 12.2613 

Closed-loop system poles: 

A, = -0.1026 

A 2 = -2.8778 

A 3 = -52.8723 

A 4 = -127.8507 

A 5 , 6 = -0.0260 ±0.1 256 j 

A 7i8 = —0.7238 ± 16.1974j 

Controller poles: 

A cl = -0.2821 
A c2 = -9.2400 
Acs = -48.3913 
A c4 = -127.2898 





106 


5.5.3 Example 3: The Four-Disc Problem 


The four-disc torsional system has been investigated thoroughly in the past decade 
(see e.g. [64] and references within) The system consists of four discs that are mounted 
on a vertical steel rod and can rotate around this rod. In the following description 
these discs are numbered according to their position in the system, i.e., the lowest disk 
is the first disc, the disc above that is disc number two and so forth. An actuation can 
be applied to this plant via a DC-motor attached to the third disc while measurements 
are available from sensors on the first disc. The inertia /3 of the uppermost disc (disc 
4) is treated as uncertainty in this system. That is, it is assumed that /3 = /3 0 + A/3 
where the nominal value /3 o for the inertia of the first disc. The reader is referred to 
[64] for more details on the physical setup of this system. A corresponding state— space 
realization of this system with A/3 as uncertainty can be given as follows. 


A 1 = 


0 1 0 0 0 0 


0 0 0 


0 

0 

0 

0 

0 


-1 0 1 

0 0 0 1 0 0 

1 0-2 0 1 0 

0 0 0 0 0 1 

0010-20 

0 0 0 0 0 0 

0 0 0 0 00 0 -/ 3 0 0 J 

c\ - ( 0 0 0 0 1 0 -1 0 ) , 


0 ^ 
0 
0 
0 
0 
0 


, B\ 


( 0 
0 
0 
0 
0 
0 
0 

V 1 / 


Bl 


/ 0 ^ 
0 
0 
0 
0 
1 
0 

V 0 / 


c x — 

K -y 


1 0 0 0 0 0 0 0 
0 1 0 0 0 0 0 0 


where the 8 states #’(<), (/ = 1,2,. ..,8) represent the angular positions 0,(f) and an- 
gular rates f2;(f), i = 1,2, 3, 4 of the four discs. That is, x](f) = 0j(f), x\(t) = Di(rf), 
xl(t) = 0 2 (t), x\(t) - D 2 (f), x^(f) = 0 3 (f), x l 6 (t) = D 3 (/) and x^t) = d 4 (t , ), 
xl(t) = D 4 (t). The uncertainty block A x (s) in this case is easily identified as 
A'(.s) = A/3. The control input distribution matrix B\ reveals the actuation on 
the third disc and G] indicates that the angular position and angular rate of the first 
disc are assumed to be measurable through sensors. 
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This plant has been considered in the framework of mixed 7T 2 /7Yoo-control design 
with the inclusion of natural damping into the open-loop system (see e.g. [7]). With 
this modification the 77oo-design problem can be solved via the DGKF-approach as 
all the relevant system assumptions for this approach are satisfied. However, without 
any natural damping it can be verified that the 7"Go-design problem for the above 
system cannot be solved by the DGKF-approach or the Stoorvogel solution to the 
suboptimal 77oo“design problem. Furthermore, without any natural damping this 
system exhibits some very interesting characteristics. 

Let us assume that A ft = 0 and examine the pure stabilization problem of the 
nominal plant for some values of the inertia ft 0 . It can be shown that the two nominal 
values ft 0 = 0.382 and fto = 2.618 represent two special plant conditions. At /i 0 = 
0.382 and ft o = 2.618 the system exhibits pole-zero cancellations on the juj- axis. For 
these inertia values the resulting undamped modes are not controllable through B\ 
and hence are not stabilizable. This implies that a controller Go can stabilize the 
above system only in the following intervals for fto'. 

0 < ft 0 < 0.382 
0.382 < fto < 2.618 
2.618 < ft 0 . 

However, no controller exists that can stabilize the system for /^-intervals that con- 
tain either ft 0 = 0.382 or ft 0 = 2.618. 

Now let us return to the problem of robustly stabilizing the above plant for Aft ^ 0 
and ft = fto + Aft: The nominal point ft 0 of the physical system is ft 0 = 1. Hence, if one 
is to design a controller at this nominal point, the maximally tolerable uncertainty 
Aft can be computed to be 

Aft max = min[ (fto - 0.382), (2.618 - ft 0 ) ] 

= min[ 0.6180, 1.618] 

= 0.6180. 

This implies that the minimally achievable H 0 0 -norm ||T^(G 0 )||oo is ||^(C 0 )||oo = 
o^f j^o = 1.6181. However, for the controller synthesis one is not required to use the 



108 


physical nominal point. In order to maximize the region of robust stability one can 
select an alternate nominal point for the design as long as the resulting controller 
stabilizes the physically nominal plant as well. This has been done for the first design 
case in the next subsection. There a nominal value ft 0 = 1.5 has been selected and a 
suboptimal 7Yoc-design problem for the single-plant case is performed. 

The second design case assumes two plant conditions, one at ft 0 = 1 and the 
second one at ft o = 4. For these two conditions a single controller is designed that 
stabilizes both systems and satisfies the specified 7-4o-bounds. 


5. 5. 3 A Case 1: Single -Plant Design 


The nominal (design) point ft$ — 1.5 for this design case is approximately half way in 
between the theoretical limits 0.382 < ft < 2.618 for which a controller can stabilize 
the plant. Robust stability in the regions 0 < ft < 0.382 and 2.618 < ft is not 
explicitly taken into account. It can be verified that with ft 0 — 1.5 the theoretically 
smallest achievable Woo-norm ||T^((7o)||oo is ll^i(^o)l|oo — 0.8945. For the following 
design the specified 7 1 has been set to 7 1 = 1.2 > 0.8945. The controller type is 
a fixed-order (fourth-order) proper controller that is structurally constrained. The 
selected controller structure realizes a P ID-type control law. The only measurement 
available to the dynamic (PI) part of the controller is the angular position of the first 
disc. The differential portion is realized by the entry D c ^\ 2 ) in the direct feedthrough 
term D c of the proper controller. This term represents a proportional control law for 
the angular rate of the first disc and hence a differential controller for the position of 
the first disc. The designed controller has the following state-space realization: 


0 

1 

0 

0 

-15.8962925007 

-23.6235424835 

0 

0 

0 

0 

0 

1 

0 

0 0 \ 

0 

-3.9218133071 

-0.8615188726 


0 ) 

C c = ( 31.5880796759 -2.3698196389 13.3336407399 3.3435177407 ), 
D c = ( -5.3906473307 2.4316125330 ) 
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The controller stabilizes the nominal (design) system with fi] = 1.5 (see table 5.6). 
The achieved 7~foo-norm guarantees stability of the closed-loop system for any ft = 
0q + A/i for 0.5811 < < 2.4189 and hence also stabilizes the nominal point of the 

physical system (fto = 1 ). The controller results in a closed-loop system that is very 
close to being unstable (note that one of the closed-loop eigenvalues is —1.9580 x 
10 6 ± 1.618 0 j ) . However, no eigenvalue constraints have been included in this design 
and hence the specified criterion - namely the 7Yoo -c °Nstraint - is satisfied. The 
singular value plot of T^(C7 0 ,.s) in Figure 5.6 confirms this fact. Unfortunately the 
designed controller does not stabilize the plant for values /i = + A ft other than 

0.581 1 < /i < 2.4189. If one requires stability in one (or both) of the above intervals as 
well, one has to formulate the ^Co-robust stability problem in terms of a multi-plant 
design problem. This will be done in the next section. 


Table 5.6: Four-disc T^-design example: Closed-loop properties for design case 1 : 
Single-plant case, /?q = 1.5. 


Nominal design point: 

L O 

II 

5? 

Specified 7 1 : 

1.2 (1.5836 dB) 

Achieved ||Ti(P„)|U : 

1.0883 (0.7350 dB) 

Guaranteed stability region: 

0.5811 < /? < 2.4189 

Closed-loop system poles: 

A, = -0.0065 
A 2 = -22.9303 

A 3 ,4 = -1.9580 x 10 “ 6 ± 1.6180j 
A 5 , e = -0.0347 ± 0.3266; 

A 7>8 = -0.1387 ±2.0247; 

A 9>10 = -0.2913 ± 0.8208; 

An , 12 = -0.3093 ± 1.5853; 

Controller poles: 

A cl = -0.6932 

A c2 = -22.9302 

A c34 = -0.4307 + 1.9329; 






5. 5. 3. 2 Case 2: Multi- Plant Design 


Here the nominal points for the two (design) systems have been chosen to be / 3q = 1 
and ft q = 4. By setting ft $ = 1 the first plant condition represents the physically 
nominal system. With this choice a single controller is sought that simultaneously 
stabilizes both plant conditions and provides robust stability for some regions in 
the interval 0.382 < ft < 2.618 (around the physical nominal point ft ^ = 1) and 
in the interval 2.618 < ft (around the nominal point ftl = 4). Note that ft here 
stands for the inertia of the real plant, the values ft^ and ft£ are only selected design 
parameters. The desired stability regions depend on the specified 'hi 0 o ~ bounds y 1 and 
7 2 . For this multi— plant example these values have been chosen to be y 1 = y 2 = 2 
and do not violate the theoretical limits for the achievable 'H . 00 — norms which are 
K( C 'o)IU = T6181 and ||T^(C 0 )||oo = 0.7236 respectively. The controller type and 
structure are the same as in design case 1 for this example. The designed controller 

ice realization: 

1 

-6.3059498695 
0 
0 


183.2410250521 40.4698252837 1.2192732255), 

D c = ( -42.1208298559 8.2785456342 ) . 

The closed-loop properties for both plant conditions show that the controller sta- 
bilizes both plant conditions simultaneously and satisfies the specified Tfoo-bounds 
(see tables 5.7 and 5.8). From the achieved -norms ||T^(f7 0 )||oo and K(C 0 )||oo 
the achieved stability regions in terms of ft can be computed. With this controller, 
closed-loop stability is guaranteed for all ft in the intervals 0.4981 < ft < 1.5019, 


0 

0 

0 


0 

0 

1 


-5.442805186824 -0.6079752614 


has the following state-sp 


A c 


( 0 

-4.4140039143 

0 

V 0 


B c = 


( 0 0 \ 
1 0 
0 0 

V 1 °7 


C c = ( 152.8606825147 
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3.4384 < ft < 4.5616. The singular value plots of both closed— loop plant conditions 
are shown in Figures 5.7 and 5.8 respectively. However, the closed-loop sytem remains 
unstable for any value of (i in 0 < ft < 0.382. If stability in this region is required 
in addition, one has to define a Tfoo-design problem with three plant conditions to 
explicitly account for this specification. 



Table 5.7: Four-disc 7± x > design example: Closed-loop properties of the first plant 
condition for design case 2 : Multi-plant case, fi\ - 1 . 


Nominal design point: 

$ = 1 

Specified 7 1 : 

2 (6.0206 dB) 

Achieved ||Ti(C 0 )|U: 

1.9925 (5.9880 dB) 

Guaranteed stability region: 

0.4981 < /3 < 1.5019 

Closed-loop system poles: 

A, = -0.3870 

A -2 = -5.4984 

A 3i4 = -0.0003 ± 1.6179; 

A 5i6 = -0.0685 ±0.1 88 1; 

A 7>8 = -0.1032 ± 0.671 2; 

A 9i10 = -0.1575 ± 1.4693; 

An , 12 = -0.1847 ± 2.4067; 

Controller poles: 

A cl = -0.8020 
A c2 = -5.5040 
A c3 , 4 = -0.3040 ±2.3131; 


Table 5.8: Four disc Tfoo^design example: Closed-loop properties of the second plant 
condition for design case 2: Multi-plant case, = 4 . 


Nominal design point: 

II 

3? 

Specified 7 2 : 

2 (6.0206 dB) 

Achieved K(C 0 )||oo: 

1.7805 (5.0108 dB) 

Guaranteed stability region: 

3.4384 <()< 4.5616 

Closed-loop system poles: 

At = -0.2394 

A 2 = -5.4984 

A 3 ,4 = - 0.0001 ± 1.6181; 

A 5 ,e = -0.0619 ±0.2784; 

A 7i8 = -0.0903 ± 2.4435; 

A 9 ,io = -0.1568 ±2.1942; 

An , 12 = -0.2791 ±0.7536; 

Controller poles: 

A cl = -0.8020 
A c2 = -5.5040 
Ac. 3,4 = -0.3040 ± 2.3131; 







Chapter 6 

THE MIXED H 2 I ftoc-PROBLEM 


6.1 The General Multi-Plant Case 


The mixed Ha /?ix> -design problem stated in definition 3.2.1 of chapter 3 is a con- 
strained optimization problem. With n p plant conditions Ei, c ,(C 0 ) and S’ 0 O>c/ (C , 0 ) 
and their respective transfer functions T.j(C 0 , s) and T^(C 0 ,s) defined in chapter 3 , 
a set of 7ip prespecified weighting parameters a' and the set of fixed robust stabil- 
ity bounds 7 *, an internally stabilizing controller (7 0 is to be found that solves the 
following optimization problem. 


where 


min lim 

O 0 


■C(Co, i/« a ) = min lim ^ a' J l 2 (C 0 , t /* 2 ), 

(-0 i S’H 2 ~ ¥ ° ° 


( 6 . 1 ) 


lim 

tfH 2 —>oo 


Jy.CnJiH,) 

•W’o.i/wJ 


4 

K(Co)||2, 


subject to n p 7-foo-robust stability constraints 


(6.2) 

(6.3) 


K(Co)|U<7', *'=l,2,..n p . (6.4) 

The pure multi-plant H<x>-design problem has been discussed thoroughly in chapter 
5. The trace-type penalty cost function defined in chapter 4 and the penalty /barrier 
function approach for the pure 7T ;x ,-design problem immediately lead to the following 
formulation of the mixed Tt-i/ H<x>— design problem. Namely, the n p Ttoo — constraints 
are formulated in terms of the tools developed in the chapter 5 . Following this 
approach the n p Hoo-constraints are transformed into a set of matrix inequalities 
which in turn are represented in terms of scalar cost functions. Ultimately the robust 
stability problem for all n p plant conditions is expressed in terms of the overall cost 
function Joo{Co, «■¥, Q, 7}) defined in chapter 5. This cost function is zero in the limit 
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as Tf an d only if all the matrix constraints and hence all -constraints 

imposed on the n p closed-loop systems are satisfied. For the following 

development it is assumed that the sets <\\ Q and 7} are the same as defined in 
chapter 5. 

As with the pure TY^-problem, there are various possible ways to pose this opti- 
mization problem in a gradient-based framework. Numerically the problem at hand 
can be formulated as a constrained optimization problem. Utilizing the cost func- 
tion Joo (Co,*, 0,7}) , one can define a constrained minimization problem to solve the 
mixed T^/^oo-problem as follows. 


min 


lim 

t fH 2 ~ > °° 


-/2(Co,*/W 2 ), 


subject to the single constraint 


(6.5) 


lim Joo(Co, A', £?, Tj) = 0, (6.6) 

where, alternatively, the single constraint (6.6) can be expressed as a set of 3 n p 
constraints such as in (5.62)-(5.64). 

If the closed-loop systems are allowed to become unstable during intermediate 
phases of the optimization, then the corresponding H 2 -norms 1 1 ( <T7 0 ) 1 1 1 are not de- 
fined and one has to use the cost function }'H 2 ) f° r a finite ^/h 2 and solve the 

above optimization problem for a monotonically increasing tf^ 2 . Once the controller 
is stabilizing all the plant conditions, then in the limit, as tj n2 — > oo, 
recovers the exact performance measure that we want to minimize (see (3.22)). This 
scheme has been developed in [64] and the formulation for the mixed 'Hi/'H oo-design 
problem as worked out in this research fits nicely into the established 7i 2 ~design 
framework. 

On the other hand, if the controller is restricted to stabilize all plant conditions 
during the whole course of the optimization, then Lyapunov equation solutions can 
be utilized to compute the exact function values 1 1 ( U7 o ) 1 1 2 and the corresponding 
gradients for all plant conditions (see (3.24)-(3.27)). However, such an optimization 
scheme must assure that the controller remains stabilizing during every phase of the 
optimization. 

Following the spirit in chapter 5, the multi-plant mixed T^/T^oo-design problem is 
formulated via a penalty/barrier function represented by Joc(Co, A', Q, 7}). 
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Definition 6.1.1 

Under the assumptions in definition 3.2.1 an unconstrained mixed Hi /hi , -cost func- 
tion J 2/oo (C 0 ,X,g,T f , tfn 2 i) defined as follows, 

J2ioo(Co,X,g,Tf,t fn2 ) = c 2 J 2 (Co,t jn2 ) + J 00 (Co,X,g,T f ) (6.7) 


with J 4 2{( ofifn 2 ) given in definition 3.2,1, Joo(Coy<¥ ,Q,Tf) as in chapter 5 and a 
scaling factor c 2 > 0. In the limit , as Tf — >00 and tj^{ 2 — ► 00 , the optimization 
problem 


'2/c 


>(Cq,X*,Q) = min 

Cq, A 


lim 

'Tj- — » 00 

t in 2 ~ > “ c 


J-2/oo(Co, X ,G, Tf, tfn 2 ) 


( 6 . 8 ) 


solves the mixed H-z/ Hoc -design strategy in definition 3.2.1 provided there exists a 
controller that satisfies all the Hoc-bounds. 


If a controller Cq and a corresponding set X* have been found such that all the n p 
7"foo _ constraints are satisfied and all the relevant ARI matrix constraints in definition 
5.1.1 are satisfied such that ARP cof (Cq, (X*)*, fi) < 0, R l > 0 and (AT*)* > 0 for 
i = 1 , 2, ,.n p , then 

lim J oo (C* 0 ,X*,g,T f ) = 0. 

1 j — *>OG 

Note in particular, that a controller Cq that satisfies this condition automatically 
stabilizes all plant conditions as discussed in chapter 3. This implies that stability 
of all closed-loop matrices A* cl is a natural result of this process and needs not be 
enforced as an additional constraint in this formulation. This is important since 
establishing stability constraints either requires additional optimization variables or, 
if defined in terms of direct constraints on their eigenvalues, these constraints may not 
always be differentiable. Hence, for a controller Cq that satisfies all ^^-constraints 
and hence stabilizes all the plant conditions, the n v H 2 -norms ||71j(C^)||^ are well 
defined and we have, along with a corresponding set A’* and (6.6), that 

lim J 2 /oo(CQ,X*,G,Tf,tfn) < oo. 

/f — ► oo 

tf n 2 

Moreover, in this case, 


lim 

Tjf — *oo 

tf 7 T 2 ~^°° 


Up 




It 


1 = 1 


(6.9) 
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which is the ^-performance cost that needs to be minimized. On the other hand, 
if one or more of the Woo-constraint are not satisfied or the controller C£ is not in- 
ternally stabilizing one or more of the closed-loop plants, then either ./ 2 (Q, or 
JooiS-'ot'^- iQ •> Tf) °r both will be unbounded in the limit as 7} — + oo and — * oo 

and hence the overall cost function will be unbounded in this case as well. Thus in 
this limit, J 2 / oo{Cq,X*,G, Tf,t fH2 ) is finite if and only if C* stabilizes all plant condi- 
tions and the set A* is such that all n p ARI-constraints are satisfied. In the following 
the expressions J 2 / 00 (C^X m ,G,T f ,t fH2 -*• oo) and -> oo) are abbreviated 

by J 2 /oo{Cq,X*,Q,Tj,oo) and J 2 (Cq, oo) respectively. This is a nice property of the 
defined cost function for the mixed 7^2/^oo~design. It also suggests an iterative pro- 
cedure similar to the one proposed in the last chapter to numerically solve the design 
problem. In [64] explicit gradient expressions for finite-time cost functions such as 
'^ 2(^01 £/h 2 ) have been derived and thus the problem can be solved for an increasing 
sequence of tj h 2 and increasing elements in 7} as a sequence of unconstrained min- 
imization problems. Alternatively, in this research a barrier function approach has 
been applied to the mixed H 2 IH 00 -design problem. The outline of such an algorithm 
is as follows. 

1. Initialization: 

Specify a set Q of desired Tfoo-bounds and a set of weighting factors i = 
1 , 2 ,..., n p . Select an initial controller guess Co of the desired structure and 
order and an initial guess for the set X as described in the last chapter. 

2. Phase one: Computation of a 7-fco-controller: 

Using the machinery developed in chapter 5, find a controller Cq that satisfies 
all Up. T^oo -constraints and stabilizes all plant conditions as well as a set X° 
such that all ARI-related matrix constraints in definition 5.1.1 and 

lim Joo(a o °,.T°,^T / ) = 0 

If — ►oo 

are satisfied. If no such controller can be found, the algorithm terminates here. 



119 


'P Phase two: Computation of the mixed ^2/^00— controller : 

Set tjn 2 = 00 select an initial ( 7 }) 1 and the scaling factor (o^) 1 such that 

(c,)'mcS,«>) = (<*)’ E«‘«i;'(cj)iii = 1 (6.10) 

i = 1 

Joo(C%,X°,g,(T f y) <1. (6.11) 

With these settings and using ( 7 ° and X° as initial guesses, set k = 1 and 
perform the following steps at the k th iteration: 

• Solve the unconstrained minimization problem 

™n J-2/ooiCo, A’, Q , ( 7 ))*, oo) ( 6 . 12 ) 

to get Cq and (A’) fc . 

• If 

lE“ , ili3(^’)ll5-i:« i K(c„ l )U3l <£ (6.13) 

* = 1 t = l 

for some prespecified e, then stop. Otherwise increase the elements in 

(T f ) k to form (X/) fc+1 and increase (c 2 ) fc to (c 2 ) fc+1 such that 

W* +, i;o i K'(Cj)||3= 1 ( 6 . 14 ) 

1=1 

and 

Jco(C*,X k ,g,(Tj) k+ ')<l (6.15) 

and repeat the minimization (6.12). 

This bootstrap method of first computing a controller that satisfies all the Hoo~ 
constraints before addressing the mixed performance/robustness strategy has many 
advantages. In general the mixed Hz/H ^ -problem has a solution if and only if 
the pure ^-problem is solvable, that is, if there is a controller that satisfies all 
n p specified ?Co _ constraints. Without the existence of such a controller the mixed 
problem has no solution. Hence, if in phase one of the above algorithm no controller 
can be found that satisfies all the 7 f,»-constraints, then there is no need to initiate 
phase two and the algorithm terminates at this point. 
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However, because the matrix inequalities representing the 'M 00 - constraints and hence 
the overall H OO -design algorithm are in general not convex, such a negative outcome 
does not necessarily imply that there is no controller at all that satisfies the desired 
Hoc -constraints. Hence, as with every optimization problem, the initial guesses and 
physical insights into the problem are of importance. However, if a controller has 
been found that does satisfy the Hoo-constraints, then the non— uniqueness of this 
whole class of controllers can be exploited to additionally minimize the performance 
cost as it is done in phase two of the algorithm. The initial guess for the over- 
all algorithm is not required to be stabilizing all the plant conditions; in general it 
can be arbitrary. The controller Cq derived in phase one of the algorithm not only 
satisfies all the Hoo^bounds but will also stabilize all n p plant conditions. In the 
second phase of the algorithm the above updates for (T f ) k and (c 2 ) k guarantee that 
all Hoo-related constraints, i.e. ARI' cof (C 0 , X { ,Y) < 0, D'J^D^ - ( 7 ! ) 2 / < 0 
and X' > 0 for i = 1,2, ...,n p remain in effect throughout the whole optimization. 
Hence Joo(0q, AC , f?, ) acts as a barrier function in the ( k T l) 4/i iteration, 

rejecting controllers that violate any of the n v 7i lXj constraints. This also implies 
that in this phase the search will be performed only over the set of stabilizing con- 
trollers. Hence we can use J 2 (Co, tfn 2 ) with the limit tjn 2 — ► oo. In this case 
J 2 (Co, oo) = £;=i «’ ll^ 2 (^o )||2 represents the performance cost in the second phase 
of the optimization. In this framework, the ^-performance cost and the respective 
gradients can be computed via Lyapunov solutions and not as a finite-time cost func- 
tion ([64]). 


The computation of this cost in terms of the grammians has been described in 
chapter 3 and the corresponding gradients for 1 1 3^2 ( ^- 00 ) 1 1 2 have been derived in ap- 
pendix B. The overall gradient expressions of J 2 /oo(Co, AC, Q, 7}, 00) with respect to 
X” are identical to the respective partial gradients of Joo(C 0 ,X,g,Tf) as the H 2 - 
performance cost is not a function of X . The gradients of the overall cost function 
with respect to Cq are as follows. 


dTz/oofCcu A*, Q _ , 7}, 00 ) 
dC 0 


Z{CiL\[L‘ t B!, + (C- u ) T D< 23 }} T 

1 = 1 

dC 0 


(6.16) 
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where L\ and L\ solve 


44 + 4(4) T +4u(4,a) T = 0 (6.17) 

44 + (4> T 4 + (Cj*) T Ci, = 0 (6.18) 

respectively. With Joo{Co, X ,G ,Tj) defined in (5.65), no further modifications are 
needed to form a well-conditioned optimization problem. That is, the additional 
performance cost does not introduce any unforeseen difficulty in terms of new unde- 
sirable local minima. 

Taking into account that the algorithm will terminate at some (7}) fc with finite 
elements, it is obvious that Joo(C^,X k ,g,(T f ) k+1 ) will never be exactly zero and 
hence the performance cost (c 2 )* +1 £"!, «‘||Tj((7 0 fc )||| will always be larg er than the 
optimally achievable. The optimally achievable performance cost will be achieved 
only in the limit as (7 })* — > oo. However, since in the second phase of the algorithm 
all the 7Yoo —l constraints will remain satisfied, there will be n p small but positive e such 
that ARIq 0 f{Go, X'iI 1 ) + el < 0, — ( 7 l ) 2 I + el < 0 and — X x + el < 0. 

Hence there will be large but finite t l f2 and V f3 for each plant condition such that 
Joo(C^X k \g } (T f ) k ^) can be made arbitrarily small and hence we can approach 
the optimally achievable performance as close as desired using the above finite-time 
algorithm. This fact is reflected in the termination criterion for the second phase, 
namely | Eg, a'||rj(C‘- , )||| - £g, a'K(C 0 ‘)||? | < £. 

As discussed before, there are principally two different design problems. For the 
simultaneous mixed T^/TCo-design problem one seeks to find a controller that is 
Tia-optimal, i.e. a controller that minimizes the above H 2 - cost and additionally sat- 
isfies the considered Tioo - bounds. Note that this problem may not be solvable even 
if a controller exists that satisfies all the specified ?Co-constraints. If such a con- 
troller exists, however, it can be expected that the achieved Woo-norms are not on 
the specified boundary. That is, there is no competition between the performance and 
the robust stability objectives. The general mixed 'Tfi/^foo-design problem addresses 
cases where the two objectives compete and a controller that satisfies the desired 'H 00 - 
bounds will not be Tl^-optimal. In this case the achieved Tfoo-norms will generally 
be at the specified boundary. The class of simultaneous mixed H-i/H* a - controllers is 
generally a subclass of the mixed ^/’Woo-controllers. The presented formulation is 
applicable to both problems. However, due to the non convexity of the overall prob- 
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lem it cannot be guaranteed that the above algorithm will converge to a simultaneous 
mixed 7Y 2 /'Hoo-controller - if such a controller exists for the problem at hand. 

If a controller of the desired structure and order can be found that stabilizes all 
plant conditions simultaneously, then an alternative algorithm for the mixed 'Hz/'Hoo- 
design problem can be formulated in terms of the “Top Down” approach introduced 
in definition 5.4.1. Furthermore, the extension of ^oo-design algorithm to the optimal 
Tioo-design problem allows the definition of an algorithm that attempts to minimize 
the above ^-performance cost subject to a minimally achievable Woo-norm for each 
plant condition. 

6.1.1 Mixed H^/'Hoo-Eesign Examples 

6. 1.1.1 A Second-Order Single-Plant Example 

Consider the following single-plant example where the closed-loop system norms 
K(C„)|| a and ||ri(C„)||«, can be computed explicitly. According to the system 
representation in (3.1) the system has the following state-space realization. 

+ ^ J j w l(t) + ^ ^ j ^ j j «*(<) 


This plant is detectable through y l (t) (not observable). Furthermore, it can be 
verified that the problem is singular and certain subsystems have invariant zeros 
on the ju>- axis (refer to [24] and [113]). The open-loop system is unstable and 
the specified controller type for this example is a static output-feedback controller 
u l (t) = C 0 y l (t ) = D c y l {t). It is easily verified that the controller will stabilize the 
plant for any D c < — 1. After some algebra we arrive at the following expressions for 


r(t) 


-l i 
o i 


..i 


(*) 


m 


1 0 
0 0 


x\t) 


z l { f ) = (-1 1 )*’(<) 

y\t) = (o l)^*). 



(6.19) 


the relevant norms as a function of the output-feedback gain D c . 

ntMoiu = 


Pi(D')h 




1 + p; 

2D,(D,-l) 


( 6 . 20 ) 


The behavior of these expressions as a function of D c is shown in Figures 6.1 and 
6.2 respectively. The corresponding mixed 'Hil'H 00 -performance/robustness tradeoff 
characteristic for this design example is shown in Figure 6.3. Every ‘o’ in Figure 6.3 
corresponds to a numerical point design while the curve connecting these points is 

the theoretically achievable T^/Woo-performance/robustness characteristic. 

The '^“Optimal controller gain D* is D* = 2.2961 resulting in the closed-loop 
^2-norm 1 1 7 ’ 2 ( /T * ) | ( 2 = 1.4486 and a corresponding Woo-norm ||T 0 o(T)*)|| 00 = 0.4355. 
Thus for any specified Ffoo-bound 7 1 satisfying 7 1 > 0.4355 the 7i 2 -optimal con- 
troller D* satisfies the specified bound ||7'J 0 ((7o)|| 0 o < 7 1 additionally. Hence for 
7 1 > 0.4355 the controller D* = 2.2961 represents a solution to the simultaneous 
mixed ^/Woe-design problem discussed in chapter 2. For 7 1 < 0.4355 a trade- 
off between the H 2 performance and robust K^-stability has to be accepted. De- 
pending on the design specifications one would then pick a point from the mixed 
W 2 /Woo -performance/ robustness tradeoff characteristic in Figure 6.3 that satisfies 
these specifications. 


6. 1.1. 2 Two- Plant F 15- Aircraft Model 

The plant in this example represents a fourth-order model for the longitudinal dynam- 
ics of an FI 5-aircraft. The first plant condition represents a subsonic flight condition 
while the second operating condition is supersonic. The system uncertainties are in 
the drag coefficient ( ( fj ) and the pitching moment coefficient (Cm,. )• The control in- 
put is the elevator control and the four states of the model correspond to the aircraft 
velocity, the angle of attack, the pitch rate and the pitch attitude respectively. The 
reader is referred to [96] for more information on the physical parameters and the 
plant model itself. 

According to the system representation (3.1), the system matrices describing the 
subsonic and supersonic operating conditions are as follows. 






II T’ (D c ) II 


25 
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First plant condition (subsonic): 


A 1 = 



0.0082 

- 25.7084 

0 

- 32.1709 ^ 



0.0082 

0.0462 > 


- 0.0002 

- 1.2763 

1.0000 

0 

>*i = 


0.0002 

0.0023 


0.0007 

1.0218 

- 2.4052 

0 

- 

- 0.0007 

- 0.0018 


0 

0 

1.0000 




0 


( 

- 0.5585 

0 

o \ 

< 

- 6.8094 





B\ = 


0 - 0.2793 0 

0 0.9991 20.9938 


0 


0 


0 


B\ = 


\ 


- 0.1497 

- 14.0611 

0 



( 0.0707 0 0 0 ^ 


1 0 > 

c} = 

0 0 0.3162 0 

. d \ 3 = 

0 


O 

o 

o 

o 


20 J 


C\ 


0.0147 0 0 0 

0 0.0147 0 0 

0 - 0.1688 0 0 


Cl = /. 


Second plant condition (supersonic): 




- 0.0117 

- 95.9107 

0 

- 32.1129 > 



0.0117 

0.0661 > 

A 2 = 


- 0.0001 

- 1.8794 

1.0000 

0 

, B} = 


0.0001 

0.0013 



0.0006 

- 3.6163 

- 3.4448 

0 

’ 1 


- 0.0006 

0.0025 



0 

0 

1.0000 

°J 



0 

0 


B\ 


- 0.7985 0 0 \ 

0 - 0.3993 0 

0 2.0457 78.4635 

0 0 0 ) 


Bl = 


( - 25.4041 ^ 
- 0.2204 
- 53.4246 
0 


C'l = Cl Dl = D} 3 , Cl = Cl d = I. 
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All the remaining system matrices are assumed to be zero. These matrices follow 
from the uncertainty description and the specified ^-criterion defined on a weighted 
combination of velocity, pitch attitude and elevator control. The controller is a first- 
order, structurally unconstrained proper controller. By applying the presented 'ht 0 o~ 
design method and the scheme in [64] to compute ^-optimal controllers to both 
plant conditions individually (note that this involves two single-plant ^-problems 
and two single-plant Tioo-problems), some preliminary information has been derived 
for this type of controller. These results and some open-loop information are given 
in table 6. 1 below. 

Table 6.1: F15 multi-plant mixed T^/^oo-design example: Preliminary analysis of 
the plants. 



Plant 1 

Plant 2 

Open-Loop: 

Stable 

Stable 

Open-Loop \\T^(C 0 = 0)|| 2 

0.1068 

0.0312 

Open-Loop HT^Co = 0)||oo 

23348.3 

8013.3 

Min. achievable 1 1 ( Co ) 1 1 2 

0.032 

0.0022 

Min. achievable ||rj o (C , 0 )||oo 

0.0563 

0.0964 


The design results for the two-plant mixed oo~design are shown in Figure 6.4 

where the first plant condition is identified by the design points (lower curve) 
and the second plant by ‘o’ (upper curve). The weighting factors a 1 were chosen to 
be a 1 = 1 and a 2 = 1. Hence both 7-f 2 -norms are weighted equally. This choice 
is justified as both plant conditions have roughly the same value for the minimally 
achievable H 2 -norm. The same TYoo-bounds 7 1 and 7 2 were applied to both plant 
conditions for each point design, i.e., 7 1 = 7 2 . Hence this is only a two-dimensional 
example out of a generally four-dimensional surface. In a mixed design for multiple 
plants, 7 will provide an actual constraint for only some of the operating conditions 
leaving the other plants unconstrained in terms of the robustness constraints. In this 
example the resulting ||7 1 J o (C7 0 )|| oo was always below the specified 7 1 while ||T^(.s)|| 00 
stays on the specified robustness boundary for all design points. This suggests that 
the supersonic flight condition is the more critical operating mode for the robust 
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stability problem. In general both curves exhibit the typical design tradeoffs involved 
in the mixed H 2 /Hoc -design. 

Judging from Figure 6.4 a controller providing the the best compromise between 
robustness and performance (taking into account both plant conditions) is achieved 
with the following first-order controller: 


A c = ( -8.55194499 ) , 

B c =( 53.16826371 -5.65806706 -19.24660504 -5.53475605 ), 

C c = ( 0.07340103 ) , 

Dc = ( -0.83757176 15.44902573 1.17896427 8.66218328 ). 

The closed— loop properties for both plant conditions with this particular controller are 
summarized in tables 6.2 and 6.3. The singular value plots for both design conditions 
are shown in Figures 6.5 and 6.6 respectively. Note that in this example the transfer 
functions 7^(C 0 , .s) generally have three singular values (as a function of ju). In 
Figures 6.5 and 6.6 only the two most significant singular values are shown, the third 
singular value function is insignificant in comparison to the other two. 

Table 6.2: F15 multi-plant mixed 7f 2 /7Tx>-design example: Closed-loop properties 
for the first plant condition. 


Achieved ||T 2 1 (C' 0 )|| 2 : 

0.0579 

Achieved ||T , < ^(C7 0 )|| oo : 

0.0805 (-21.8758 dB) 

Closed-loop system poles: 

A, = -0.7958 


A 2 = -4.2007 


A 3 = -7.9336 


A 4i5 = -6.2490 ± 14. 302332 j 
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Table 6.3. F15 multi plant mixed -design example: Closed— loop properties 

for the second plant condition. 


Achieved ||T 2 2 (Co)|| 2 : 

0.0771 

Achieved ||7* (C 0 )||oo: 

0.115 (-18.7860 dB) 

Closed-loop system poles: 

Aj = -0.4658 

A 2 ,3 = -7.7470 ± 5.9286; 

A 4i5 = -21.5206 ± 18.3541; 


6.2 Mixed HJHoo- Control: The Single-Plant Full State-Feedback Case 


The most general 7~too and mixed design problems are in general not convex, 

not even in the single plant case. However, for a very special class of single plant 
problems an upper bound for the 7i 2 - cost in conjunction with a particular controller 
parametrization can be formulated as a convex optimization problem. When convex- 
ity of the cost function holds (see chapter 4), this problem can then be solved via an 
unconstrained scalar, differentiable and convex minimization problem. Since only the 
single-plant case is considered here, the superscript (*)‘ is omitted in the following 
discussion. For this problem the system under consideration is assumed to have a 
state— space realization of the following form. 


^‘ 2/00 yOPySF * ^ 


x(t) = Ax(t) + B x w(t) + B 3 u(t) 

22 (f) = Cix(t) + D l3 u{t) 

2<x>(f) = C' 2 x(t) T D 23 u(t ) 

( y{t) = x(t). 


( 6 . 21 ) 


The system E 2 /oo, op, sf is to satisfy the following assumptions (see [58]): 


1 . Z ?23 has full column rank. 


2. The matrix pair 

[(/ — ^ 23 (^ 23 ^ 2 . 3 ) 1 Dj 3 )C2 , —A + B 3 ( O ^ D 23 ) ~ 1 D% 3 C 2 ) 


is observable. 
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The need for these assumptions will be discussed later. The dimensions of all the 
signals are: x(t) G /?"*, w(t ) € ft 71 ™, z 2 (t) G R 71 * , 2oo (f) G ft 71 * 00 , u(<) G /C u . The 
controller is a static full— state feedback controller given by 

u{t) = C 0 y(t) = C 0 x(t). (6.22) 

First and most importantly, there is no distinction between two disturbance signal 
vectors w 2 (f) and as was done in the general case. In this formulation w(t) 

plays a dual role as a T^-disturbance and a ^Co-disturbance. In practical terms 
this implies that the disturbances w 2 (t) and are assumed to affect the system 

through the same input distribution matrix £?,. The uncertainties in this problem 
are still modeled by a stable, norm bounded A(.s)-bloc.k with a feedback connection 
re(.s) _ A(.s)z 00 (.s) and the %oo~ bound || A (. s )|| 00 < Note that in general a direct 
feedthrough term from w(t) to z<x>(0 can be incorporated as well. However, with 
preliminary transformations described in [113], this case can always be reduced to a 
state-space description of the form in (6.21). 

With a static state-feedback controller Co, the closed-loop system E 2 /oo , c l,SF is 
given by 

{ id(t) = (A + B 3 Co)x c i(t) + B ct w(t) = AciXdit) + B\w(i) 

z z(t) = (Cl + Di 3 Co)x c i(t) = C c l' 2 X c [(t) 

Z °o(t) = ( C 2 + D 23 C 0 )x c i(t ) = Ccl,oa'Xd(t). 

(6.23) 

For this type of systems, the mixed TC/TCo-design problem is essentially the same 
as the previously considered problem, only that the H 2 - cost is now defined for the 
closed-loop transfer function T 2 (s) from w(. s) to z 2 (s) and the corresponding 
constraint on the closed-loop transfer function T 00 (. s) from w(s) to ^(.s). With these 
definitions the problem statement is similar to that stated in definition 3.2.1 for the 
single-plant case with n p = 1, and is omitted here. Assuming that a state-feedback 
gain C 0 stabilizes the closed-loop system then the 7i 2 - cost is 

ll^(C 0 )|| 2 2 = Trace{ C da L c Cl a } (6.24) 


where L c solves 


LcA^i + A c iL c + B cl Bl — 0. 


(6.25) 



The 'Hoc constraint on T 0O (.s) such that HTo^CoJHoo < 7 for a specified 7 can be 
represented by the ARI 

ARIc,sf{C 0 , A\7) < 0 (6.26) 

ARIcMC 0, 7) := + /1 C ,X + j- 2 XCl 2 C cW2 X + B cl Bj t (6.27) 

subject to X > 0. By subtracting (6.25) from (6.27) it immediately follows that 
X > L c if ARIc,sf{Co, X, 7) < 0 is satisfied and hence the cost Trace{ C c i <2 XCj l2 } 
is an upper bound for the T^-cost ||T2((7 0 )||| if (6.26) is satisfied. This fact was 
first reported by Bernstein et. al. and has been investigated thoroughly in [6], [7], 
[47], However, there is no reason to consider an upper bound to the T^-cost if no 
additional advantage can be derived. 

Now consider a controller factorization of the form C 0 = W X~ l where IT is a real 
matrix W 6 R n “* n *. For this factorization the following abbreviation is introduced. 

ARI c ,sf(C 0 = WX~\X, 7) = ARI c ,sf{W,X,7). 

With such a factorization the following results have been derived in [55] and [56]. 


Lemma 6.2.1 ([55], [6]) 

Consider the closed-loop system S 2 /oo ,cl,SF wit h a fixed Hoo-hound 7 and let C 0 = 
WX 1 with X = X T > 0 and W £ R Uu XUx , then the following holds: 

1. For constant 7 the. matrix function ARIc, ,sf(W,X, 7 ) : (W,X) -* R n x x n x 

ARIc,sf(W,X,i) = XA t c1 + + 7 - 2 XC%C clt2 X + B cl Bj t (6.28) 

= X\A B 3 W X *] T + [A 4- B 3 W X~^\X (6.29) 

+j- 2 X[C 2 + D 23 WX~Y[C 2 + D 23 WX~ l ]X + B l Bj 
= XA T + AX + B 3 W + W T Bl + B, Bj 

+1~ 2 [C 2 X + D 23 W] t [C 2 X + 0 23 W] (6.30) 

is jointly convex in X and W. Furthermore, there exists a static state -feedback 
C 0 = W X~ x such that ||T oo ((17 0 || oo < 7 if and only if there are X = X T > 0 and 
W such that ARI c ,sf(W, A', 7) < 0. 



2. The scalar quantity 


J 2 MWX) = Trace{[C\ + D^W X~ l )X{C, + D l3 WX^] T ) (6.31) 

is jointly convex in X and W. Moreover , if X = X T > 0 and W exist such 
that ARIc sf{ W, X, 7 ) < 0 , then 

hMW,X) > II T 2 (C 0 = WX~ 1 )\\l = \\T 2 {W,X)\\l (6.32) 

Two important remarks ran be made at this point. First, no means are available 
to determine the gap between the upper bound J 2 t SF{W, X) and the actual Ti^—cost 
\\T 2 (C 0 ) Hjj and hence the upper bound can be very conservative. Secondly, although 
the above lemma gives an if— and— only— if condition between the existence of a con- 
troller C 0 = W X 1 that satisfies the specified TYoo-constraint, not all possible con- 
trollers that satisfy the TLoo ~ { constraint are included in the class of possible solutions 
X and IT' that satisfy the 7Yoo -c °iistraint. 

To illustrate this fact, assume that the controller Q — W*(X~ 1 )* satisfies the 
Woo-constraint. Then C* = [ftW*][±{ A "" 1 )*] satisfies the ^-constraint as well 
for any scalar ft ^ 0. However, there will always be a positive ft such that con- 
dition 4 in theorem 2.2.1 is violated and hence ^(X" 1 )* and [ftW*] do not satisfy 
ARIc,$f{W, X, 7) any more. Hence, despite the necessary and sufficient condition 
for the existence of a TYoo-suboptimal controller, not all possible controller charac- 
terizations in terms of X and W are included in lemma 6 . 2 . 1 . Thus, if additional 
performance measures are to be achieved based on these individual controller compo- 
nents, the above TYoo -bound characterization is conservative. Note that this scheme 
is applicable only to the single-plant problem as the controller parametrization di- 
rectly depends on the solution X of ARIc$f(W, X , 7) < 0. Despite its conservatism, 
the formulation of an upper bound mixed W 2 /? 4 o-problem in terms of (6.32) and 
(6.29) has the advantage that it results in a convex optimization problem to which the 
penalty cost function approach is applicable. Following the framework established so 
far, this problem can now be formulated as follows. 



Definition 6.2.1 

For the open-loop system S 2 /oo ,op,$F in (6.21) and a prespecified 'H 00 -bound 7 , find 
two matrices IT* and X* — ( X*) T > 0 and a corresponding static state-feedback 
controller (7q = W*(X~* )* that solves the minimization problem 

'hMW\X*) = min J 2 ,$f{W,X) 

subject to 

Km Joo,$F(W*,X*,~ffi fu t f3 ) = 0, 

t/i — ■ 00 

i/ 3 — *-oo 

where 

= Trace { + e -X< /3 } ( 6 . 35 ) 

Some interesting results have been derived for this type of problem. Most importantly, 
in [58] it has been shown that for the general mixed Hz/Hoo-problem a dynamic state- 
feedback controller Co will not outperform a static state-feedback controller. That 
means that we can restrict our attention to the class of static full -state feedback 
controllers. Note, however, that this is not necessarily true for the simultaneous 
mixed Hi/Hoo-problem. 'Hi-optimal controllers that additionally satisfy a specified 
Hoo -constraint on Too(.s) may in general be dynamic for this problem ([92]). In this 
work the attention is restricted to the static case and hence to the general mixed 
UijH 

OG problem. Extensions to the general dynamic case are easily incorporated 
and will form a convex optimization problem as well. 

The design problem can be solved numerically in the same way as the multi- 
plant mixed 'H^/'Hoo-pvoblein. Note in particular, that for any given tj i and f/ 3 , 
the resulting minimization problems are convex as J- 2 y sF{ W,X), ARIq ,5f(VT,V, 7) 
and -X are jointly convex in W and X and hence, with the results in chapter 
2, Joe X,j,tfi,tfo) is jointly convex in W and X as well. As the sum of 

convex functions is convex, overall convexity follows. Thus, using the penalty function 
algorithm, the upper bound mixed Hi/Hoo-problem can be solved via a series of 
unconstrained convex minimization problems. Note also that in this case the closed- 
loop system may be unstable during intermediate phases of the algorithm as the 
Hi— cost is not computed in terms of a Lyapunov solution. As before, once W* and 
X* — (X*) T > 0 have been found such that ARIc,sf(W, X, 7 ) < 0, then closed-loop 


(6.33) 

(6.34) 
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stability automatically follows. The convexity property holds for any factorization 
of A imposing X = X T as discussed in chapter 5. Furthermore, the assumptions 
imposed on the open-loop system assure that the solutions W and X are finite and 
simultaneously avoid local minima that do not satisfy the 'H. 00 — bounds. In general 
these constraints can be removed by adding an auxiliary cost to ensure bounded 
solutions of W and X (see chapter 5). 


6.2.1 Full State-Feedback Mixed Fill 'H 00 - Design Example 

The example plant is the 4 ( ^— order system used in [101]. It represents the scaled 
subsystem of the lateral dynamics of a B-767 aircraft with uncertain entries in the 
open-loop /1-matrix. The state-space matrices for this plant are as follows. 

( -0.0168 0.1121 0.0003 -0.5608 \ 


CW. 

All other matrices are assumed to be zero. The open-loop system is stable, the rele- 
vant open-loop norms are ||T , 00 (Co)|| 0 o = 7.4826 and 1 1 ( C7 0 ) 1 1 2 = 0.9260 respectively, 
the open-loop subsystem T oo (C 0 ,s) has zeros in the right-half plane, the minimally 
achievable ||T oo (C7 0 )|| oo is 0.007 and the minimally achievable 7T 2 - norm ||r 2 (Co)|| 2 
is 0.0078 when the FI <*> and 7f 2 — problems are solved independently for the state- 
feedback case. 

The mixed 77 2 /7T x - ; -performance/robust ness characteristic for this state-feedback 
case has the same interpretations and properties as that in the general case output- 


A = 


-0.0164 -0.7771 0.9945 

-0.0417 -3.6595 -0.9544 

0 0 1 


By = 


1 1 


^ -0.0243 ^ 

0 


-0.0634 


J 5,3 — 


0 


-3.6942 

V 1 ) 


l °J 


0.1 


Cl = ( 0 0 1 0 ) , z\,= 1 , 

C 2 = ( 0.01 0 0.01 0 ), £>23 = 0 . 01 , 
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feedback case. This tradeoff is shown in figure 6.7. A good tradeoff between the 
^-performance and stability robustness can be achieved with the following state- 
feedback gain matrix. The matrices W and X from which D c is computed are 

w = ( -0.73383998 -0.28674417 -0.22309747 0.67626086 ) 

( 13.77087597 0.60885959 0.26514956 2.21194320 \ 

x _ 0.60885959 0.24309849 0.18079149 -0.52517534 

0.26514956 0.18079149 0.15950869 -0.52847260 

v 2.21194320 -0.52517534 -0.52847260 2.61509640 j 

From these matrices W and X the controller gain D c then follows from D c = WX~'. 

A- = ( —0.04438848 -0.83242054 0.13897734 0.15705908 ) . (6.36) 

The closed-loop properties for this particular controller are summarized in table 6.4 
and the corresponding singular value plot of the closed— loop system is shown in Figure 
6 . 8 . 

Table 6.4: B-767 mixed 'H-il'Hoo -design example, full state-feedback: Closed loop 
properties. 

Achieved ||T 2 ((7 o)|| 2 : 0,2335 

Achieved |lT , oo (C7 0 ) Hqq ; 0,0921 (-20.7103 dB) 

Closed-loop system poles: Ai = —0.4653 

A 2 = -7.5807 

A 3)4 = -0.6025 ± 0.7529; 




II T„ (C D ) ll_ 

Figure 6.7: B-767 mixed Tii/Hoo -design example, full state-feedback: H 2 IH 
performance/robustness characteristic. 



Frequency (rad/sec) 


Figure 6.8: B-767 mixed -design example, full state-feedback: Singular val 

plot of 7 1 oo (C' 0 ,s). 





Chapter 7 

CONCLUDING REMARKS 


In this work a new approach for the general and mixed ^2/^0 ©-design prob- 
lems has been presented. The approach is based on the representation of 
constraints in terms of matrix inequalities. By the use of a new type of scalar 
cost function these matrix constraints have been converted to scalar differentiable 
constraints that can be appended to any performance-oriented optimization prob- 
lem. This formulation makes the mixed 7 Y 2 /Hoo-design problem amenable to a 
gradient-based solution. The developed scheme can incorporate features such as 
fixed-structure/fixed-order controllers, it can accommodate multiple operating condi- 
tions and places only a minimal set of system assumptions on the open-loop systems. 
In particular it does not impose assumptions on the system zeros or orthogonality 
conditions as in previous formulations and provides a general framework for the 
and mixed ^/Tioo-design problems. 

In general there is a variety of possible ways to formulate the optimization prob- 
lems associated with the and mixed ^/^foo-design problems. Some of them 
have been discussed so as to point out alternative routes for posing the minimization 
problems. In this work a single cost function has been defined that contains all the 
performance cost functionals as well as the penalty /barrier functions associated with 
the 7 Yoo -c oustraints. With this overall cost function the Tfoo and mixed oo~ 

design problems reduce to a sequence of unconstrained minimization problems. Cor- 
responding gradient expressions for all the cost functions have been derived in the 
appendices. The analysis of these partial gradients has provided valuable informa- 
tion on the existence of local minima that do not satisfy the desired H^-constraints. 
Possible ways to exclude such local minima have been presented and discussed. 

The defined trace-type cost function has the property that it is convex if the 
underlying matrix inequality is convex. This fact allows the formulation of a differ- 
entiable convex optimization problem for the full state-feedback single-plant mixed 

n 2 jn 

00 problem applied to a special class of systems. For this class of systems a 
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convex upper bound for the is considered subject to a set of convex matrix 

inequalities representing the , H 00 -constraint. However, in the general multi-plant 
case (or the single-plant case with the exact % 2 -norm as performance measure) the 
7^2— cost and the matrix inequalities enforcing the Woo-constraints are not convex. In 
this case one can devise alternative optimization schemes based only on the eigenval- 
ues that violate the considered matrix inequality constraints and/or on finite-time 
7"f 2 -performance costs [64]. The contents of appendix A is intended to serve as a 
basis for the derivation of explicit gradient expressions for such schemes as well as 
for other modifications to the presented formulation of the Hoo and mixed / H 2 /'H 00 - 
design problems. The included examples are non-trivia] and provide valuable tests 
for the capabilities of the presented scheme. 

In the appendices C and D it is shown that the reformulation of the 7ioo ~ constraints 
in terms of the defined cost function can be applied to 7~foo~constrained control prob- 
lems where the “performance” criterion is not an 7i 2 -norm. 

In appendix C the performance criterion is identical to the Froebenius norm of 
the static state-feedback gain matrix while the Woo-constraint guarantees robust 
stability. Such a performance measure has implications for the noise-sensitivity as 
well the control effort in the closed-loop system. 

In appendix D performance correlates to time-domain constraints that are refor- 
mulated in terms of convex scalar constraints on the closed-loop system matrix and 
the state-feedback gain matrix. Furthermore, the problem formulation for the 
constrained control problem with time-domain constraints illustrates the applicability 
of the presented scheme to discrete-time ^-constraints. Also, for this problem the 
LMI-characterization of Woo-constraints has been utilized. Corresponding gradients 
are stated and hence the use of the penalty cost function for the enforcement of 
block-structured matrix inequalities is exemplified. 

The design methodologies in appendices G and I) show that the trace-type cost 
function not only allows the incorporation of robust stability in terms of Tioo-constraints 
in any (gradient-based) performance-oriented design problem. These applications 
also illustrate that the cost function is applicable to reformulate other (convex) sym- 
metric matrix inequality constraints as (convex) scalar constraints. It is hoped that 
this capability opens up venues to solve problems other than these considered here. 



Chapter 8 

EXTENSIONS AND FUTURE RESEARCH 


The defined cost function allows the reformulation of the and mixed 'Hz/'Hoo- 
design problems as differentiable constrained or unconstrained optimization problems. 
To avoid local minima, however, it is necessary to modify the design equations or to 
introduce additional constraints. The use of other ARI-forms (see (2.22) - (2.24), 
(2.32) or (2.26)), the reformulation of TYoo-constraints in terms of LMI’s (see lemma 
2.2.5) or a combination of some of these inequality constraints may form a computa- 
tional framework that eliminates the possibility of undesirable local minima without 
additional constraints. That is, a matrix inequality representation of a T^oo-constraint 
(or a combination of such matrix inequality constraints) is sought such that all the 
partial gradients of the functional representation in terms of the defined cost func- 
tion are zero if and only if the corresponding Ti^-constraint is satisfied. A thorough 
analysis of the corresponding gradient expressions should prove valuable for this task. 

Although explicit second-order gradients could not be found for the defined trace- 
type cost functions, using (A. 80) it appears to be possible to find computable expres- 
sions for the second-order derivatives (see [64]). This should improve the convergence 
of the nonlinear parameter optimization considerably. Furthermore, for an efficient 
solution of the arising optimization problems associated with the Hoo and mixed 
n 2 /n GO -design problems “dedicated” software is necessary that takes into account 
the specific characteristics of the defined minimization problems. In particular spe- 
cialized C or FORTRAN code combined with contemporary nonlinear optimization 
software should provide acceptable speed for the function evaluations and gradient 
computations as well as the search direction updates. 

So far all 7"foo-design methods depend in one way or another - on the solution 
of ARE’s or ARI’s (LMI’s) which requires the introduction of additional design pa- 
rameters other than the controller entries, namely the sought-after solution to these 
ARE’s, ARI’s or LMI’s. This necessity increases the number of optimization vari- 
ables if a gradient-based parameter optimization scheme is used to solve the design 
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problem. The eigenvalue structure of the Hamiltonian in 2.2.2 on the other hand 
provides a means to test whether a closed-loop Hoo-bound is satisfied or not, based 
only on the closed-loop system matrices and hence dependent only on the controller 
Co. Hence the exploitation of the special eigenvalue distribution of M \ may provide 
a unique tool to solve suboptimal ^oo-problems with a considerably lower number of 
design variables. This fact justifies further research along these lines. 

Possible extensions of the presented research include the mixed TG/TGo-estimation 
problem as well as //-design and ultimately mixed ?G/ //-design philosopies if the un- 
certainty structure is known and can be exploited. 

The //-design problem can be viewed as a scaled ?Go-problem with additional 
scales D($) which can be considered as additional optimization variables. Assuming 
a state-space representation for the scales D(s ), one can form a state-space repre- 
sentation of the closed-loop system as a function of the controller Co and the system 
matrices describing D(s). The // design problem is then equivalent to an 7Gx>-bound 
on this (scaled) closed-loop system and thus to a matrix inequality. Hence the exten- 
sion of the presented ?Go“design philosophy to the //-design problem follows naturally 
from the considerations in this work. Once this problem is solved, the mixed 7Y 2 ///- 
design objective is approached in the same way as the mixed ?G/?Go-design presented 
here. Note that this formulation allows the solution of the fi and mixed ^///-design 
problems in terms of a sequence of minimization problems that are guaranteed to 
converge (though not necessarily to the global optimum). Furthermore, requirements 
for fixed-order controllers can be accommodated. Present design algorithms cannot 
guarantee convergence and often result in controllers with extremely large order, a 
property that is not tolerable for practical control applications. 

Mixed ^G/Woo-estimation on the other hand is the natural counterpart to the 
mixed TG/Woo-control problem. Both LQG and Kalman filtering problems require 
the plant to be known exactly, uncertainties as considered in this work cannot be 
incorporated. Mixed 7G/?Go-estimators could prove to be important tools for design 
problems where internal states of the system need to be estimated in an a 7G/?Go- 
optimal” sense. 

Finally, due to the versatility of the defined cost function it is expected that future 
research will show that other control problems can be posed as matrix inequalities 
which in turn can be solved by the presented penalty /barrier function approach. 
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Appendix A 

AUXILIARY MATRIX RESULTS 


A.l General Matrix Results 


This section provides matrix results that are of importance to the proofs in this 
repoit. Most of the lemmas are stated without proof. The proofs can be found in 
the respective references. 


Lemma A. 1.1 (Schur Complement) 

Let G, H and L be real symmetric matrices, then 


if and only if 


( G L 
{ L T H 


G L 
L T H 



H > 0, 
G-LH~ l L T > 0. 


(AT) 


(A.2) 
(A. 3) 


The Schur complement formula is the basis for the transformation of ARI-type 7ioo~ 
characterizations into any block structured inequality constraint such as in lemma 
2.2.4 and lemma 2.2.5. 


Theorem A. 1.1 (Weyl’s Theorem, [49], p.181) 

Let G, H G R nXn be Hermitian matrices, let the eigenvalues of G , H and 6'+ H be 
arranged in the following order 

Ai (G) < A 2 (G) < ... < A n (6') = \(G), 

^i(H) ^ A 2 (H) < ... < A n (H) = A (H), and 

A i(G+H) < \ 2 (G+H) < ... < A n (G + H) = A (G + H), 

then 


A i(G+H) < Xi(G) + X(H) 


(A- 4) 
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for i = 1,2, ...n. 

In particular we have 

\(G -f H) < \(G) + \(H). 

Furthermore, for H < 0 we have the monotonicity properties 

A i(G + H) < A i(G) 

\{G + H) < A (G) 

and, for H > 0 


for i = 1 , 2, ..., n. 


A % {G) < \i(G + H). 


Lemma A. 1.2 ([133], p.630) 

Let G, H e R nxn be two real symmetric matrices such that G > 0 and H 

Trace(GH) < A (G)Trace(H). 


Lemma A. 1.3 

Consider two real symmetric matrices G and H , them 


G < H 


Trace[e G \ < Trace[e H ]. 


Lemma A. 1.4 ([50]) 

Consider two real symmetric positive-semide finite G and H and a £ (0,1) 
Trace{G a H^} < [Trace(G)} a [Trace{H)f~ a l 


(A.5) 

(A. 6) 
(A. 7) 

(A. 8) 

0 , then 

(A. 9) 

(A. 10) 
then 

(A.ll) 


This lemma is a direct consequence of Weyl’s theorem and the continuity property of 
eigenvalues of hermitian matrices. 



Lemma A. 1.5 (Arithmetic— Geometric Mean Inequality, [3]) 

Let a and b be two non-negative scalars, then 
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a a b^ "* < ora + (1 — a)b 


(A- 12) 


for every «£ (0, 1). 

Lemmas A. 1.4 and A. 1.5 can be combined to yield the following result. 

Lemma A. 1.6 ([50]) 

Consider two real symmetric matrices G and II. ex C (0, 1) and a real positive scalar 
tj, then 

Tract{^ aG +( x - a WC) < aTrace{e Cil f) + (l- a)Trace(e Ht f). (A. 13) 


Lemma A. 1.7 ([50], [67]) 

Consider the matrix— valued function A/ ( G ) = Cf^ MG with H = // ^ ^ 0 and ex £ [0, 1] 
and G, H of compatible dimensions such that M(G) is defined. Then 

aM(Gi) + (1 - a)M(G 2 ) - M[aG\ + (1 - a)Gf\ = 

a(l - cv)(6’i - G 2 ) t (G 1 - G 2 ) > 0 (A. 14) 

for two matrices G \ and G 2 of compatible dimensions. 


Lemma A. 1.8 ([50], [67]) 

Consider the matrix-valued function M(G) = G _1 for G = G T > 0. Let G\ and G 2 
be two matrices satisfying G, = Gf > 0 and G 2 = G\ > 0, then 

c*M(G\) + (1 - a)M(G 2 ) - M[aG\ + (1 - a)G 2 } = (A.15) 

«(1 - c*)(7f 1 (G 2 - 6’i)G.J 1 M[aG\ + (1 - a)G 2 }~ x Gf\{G 2 - G\ )G 2 ] > 0. 
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Note that lemmas A. 1.7 and A. 1.8 imply that Trace {G T HG} is convex in G for 
H — H T > 0 and that T race { G~ 1 } is convex on the set of of symmetric positive- 
definite matrices. Next some convexity results are presented that are utilized in 
appendices C and D. 

Theorem A. 1.2 

For real matrices G = G T > 0 and real positive scalars r the scalar-valued function 
f(r, G) given by 

f{ r ,G) = r 2 A(G’ _1 ) (A. 16) 

is jointly convex on G and r. 


Proof: The proof utilizes results in [58] and is very similar to that. As /(aT,o6') = 
G) we only have to show that 


fij 1 d” T 2i G 1 + G 2 ) < /(t 1 , G\ ) + /(t 2 , G 2 ) (A. 1 7) 


for two arbitrary real symmetric positive-definite matrices G\ and G 2 and two positive 
scalars T] and t-i- Let T be a nonsingular matrix such that 


T t G\T = Aj = i = l,2,...,n (A. 18) 

T t G 2 T = A 2 = diag(\ 2 ,i), t = 1, 2, ..., n. (A. 19) 


Such a matrix T exists for positive-definite matrices G x and G 2 (see [58]). 


where f i\) l 
Thus 


f( T 1 T + (* 2 ) — A[(ti T t 2 ) 2 (G\ + G 2 ) ] ] 

= A[r-'{rfiai/( <Tl ~(^ )2 )}r- T ] 

T >*2,1 

= X{T-'{d,ag(ji- + lL + ^ )] T-T] 

>*2 ,t 

= A[r 1 2 r- 1 A 1 - 1 T- T + r|T- , A.- 1 T- T 

+T~^ diag(fji)T~ T ] 


(A. 20) 
(A. 21) 

(A. 22) 

(A. 23) 
(A. 24) 


/( r 1 + r 2) G\ + G 2) = Afr^G'] 1 + t 2 G 2 1 + Q] 


(A. 25) 



163 


for Q = T 1 diag(i/>i)T T < 0 and hence 


f( T i + r 2> G\ + G-i) < A(t 1 2 6 , 1 1 + t 2 Gt 2 1 ) (A. 26) 

< + (A. 27) 

= /( r i» G\) + /(t2, G-i) (A. 28) 

which implies joint convexity in r and G for G = G T > 0. The inequalities follow 
immediately from the above Lemmas and Weyl’s Theorem. An alternative proof can 
be constructed using Fischer’s min-max theorem (see [67]). ■ 


Theorem A. 1.3 

For real matrices G = G 1 > 0 and real positive scalars t the scalar-valued function 
f(r,G) given by 

I(t,G) = T’race(r 2 G -1 ) (A. 29) 

is jointly convex on G and r. 


Proof: A proof can be constructed using the same tools as above. It is essentially 
equivalent to the proof of Lemma 4.4 in [58] and is omitted here. H 


Theorem A. 1.4 

For real matrices G = G T > 0 and real positive scalars r the matrix — valued function 
M (r, G) given by 

M(t,G) = —^l — G. (A. 30) 

Then the matrix function M(t,G ) is jointly convex on G and r. 

Proof: M(t,G) is affine in G. ~ is a strictly monotonically decreasing function for 
all r > 0. .Joint convexity on G and r follows immediately. ■ 



164 


A. 2 Gradient-Related Matrix Results 


In this section various gradient based matrix results are stated that are required in 
the derivation of explicit gradients for the cost functions considered in this work. The 
notation concerning gradients with respect to matrices, vectors or scalars is standard 
and corresponds to that in [67], [133] and references therein. These references as 
well as [90] are excellent sources for further results related to gradient computations. 
In the following scalar functions f{K) and matrix- valued functions M(K) of a real 
parameter matrix A are considered. The matrix A here need not be square and is 
assumed to be a general real matrix of dimensions r x ,s. Of course, K may also be 
a vector or scalar. Also, the attention of this section is restricted to differentiable 
functions and their gradient computations. In general the ARI’s and other functions 
in the presented formulation for the Ttoo- and mixed /7/x> -problems depend on two 

parameter sets represented by the controller parameters in Go and the sought-after 
solutions to the inequality constraints. These two parameter sets are independent 
and hence gradients can be derived independently for the two sets. In this appendix 
the matrix A can either be the controller representation Co or the parameter matrix 
X x . Assuming that a scalar function /(A ) is differentiable in all the elements of A , 
f(K) can be linearized around a nominal point K 0 as follows. 

/(AT + dK) = /(AT) + df(K 0 , dK) + r(dK). (A. 31) 

Here df(K 0 ,dh) is linear in the variation dK of the parameter matrix. Furthermore 
df(K 0 ,dK) = 0 for dK = 0. The residual term r(dK) collects all the higher-order 
terms in dK with r(dK) = 0 for dK = 0. 

Gradient computations of scalar functions with respect to vectors have a long 
history in control theory. Many functions f(K) can be converted to such a vector 
problem by using a vector representation vec(K) of the individual elements of I\, 
K = hij (i = l,2,...r, j = 1,2, ...s) as follows. 

vec(K) = ( A' m K 2 ,i K r , , I < h2 I< Vi .. K r - 2 .. K r , s /. (A.32) 

Even if this is not possible, gradient expressions of differentiable scalar functions 
with respect to matrices can always be reduced to the vector case by forming a 
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corresponding vector representation vec(dK) for the matrix dK to yield the expression 


df(K 0 ,dK) = ( 


df 

dK u 


<Kf 

dK xa 


dj_ 

dK r ,s 


) vec(dK), 


(A. 33) 


which directly specifies the individual derivatives of f(l\) with respect to K, , . Ac- 
cordingly we can define the same linearization for the matrix case. Consider a matrix- 
valued function M(K) (not necessarily square) where every entry of M(K) is differ- 
entiable in all individual matrix elements of K, then the matrix equivalent to (A. 31) 
is 

M(h 0 + dK) = M(K 0 ) + dM(K a ,dK) + R(dK) (A. 34) 

with equivalent properties for dM(K 0 ,dK) and R(dK). A form of dM{K 0 ,dK) cor- 
responding to (A. 33) can be derived by the application of the Kronec.ker product 
formula and a representation vec(dK) of dK as in (A.33) (see [67]). However, for this 
work it is not necessary to invoke such tools since all the cost function gradients can 
be reduced to a form to which Kleinman’s lemma is applicable. There is a multitude 
of results concerning gradients with respect to matrices for scalar functions, vector- 
and matrix-valued functions. A complete review of the underlying theory is beyond 
the scope of this appendix. In the following some results are reviewed that form a 
complete basis for the derivation of the cost function gradients necessary for the pre- 
sented research and possible extensions as discussed in the body of this report. The 
reader is referred to [67] for a more in-depth information on this subject matter. The 
product i ule and the Cauchy invariance theorem for nested functions are well known 
facts for scalar functions of one variable. Important for this research is that there are 
matrix equivalents for various scalar differentiation rules as follows (see [67]). 


1. Linearity: 

Let G(K ) and H(K ) be two matrix-valued functions of a real matrix K re- 
spectively, where G(I<) and H(K) have compatible dimensions such that the 
matrix-valued function M(K) = aG{K) + (3H(K) is defined for some real 
scalars o and (3. Assume furthermore that both matrix-valued functions are 
differentiable at K 0 , then 


dM(K 0 , dK) = adG(K 0 ,dK) + / 3dH{K 0 , dK). 


(A.35) 
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2. Product rule for the matrix case: 

Let G(h ) and H(K) be two matrix valued functions of a real matrix K respec- 
tively, where G(K) and H(K) h ave compatible dimensions such that M(K) = 
G (K)H(K ) is defined. Assume furthermore that both matrix-valued functions 
are differentiable at K 0 , then 

dM(K 0 , dK ) = [dG(K 0 , dh )]H(h a ) + G(K 0 )[dH (K 0 , dK )]. (A. 36) 

3. Cauchy invariance theorem ([67], theorem 13, chapter 5, page 96): 

Let G(L) and L = H(K) be two matrix-valued functions of real matrices L and 
A respectively, where G(L) and H (K) have compatible dimensions such that 
the nested function A/(A) = G[H(K)] is well defined. Assume furthermore 
that G(L) is differentiable at L a with L 0 = H(K 0 ) and H(K) is differentiable 
at K 0 , then 

dM(K 0 ,dK) = dG[L 0 ,dH(K 0 ,dI<)}. (A.37) 

These important results will find repeated application in the computation of various 
cost function gradients derived in appendix B. In addition to the above theoretical 
framework a result is necessary that is related to matrix inverses. Assume that K is 
a quadratic matrix such that |A | ^ 0 for A = A 0 and consider the matrix— valued 
function A/(A) = A C For such a matrix function it has been shown ([67], theorem 
3, page 151) that 

dM(K 0 , dl< ) = - A'; 1 (dK)K ^ . ( A.38) 

In general, with the product rule and the Cauchy’s invariance theorem we can state a 
more general form for matrix functions involving matrix inverses. Consider a square 
matrix-valued function M(K) = [i G(K)H(K )]~ 1 with the assumption that M(I<) is 
nonsingular at K a . Then it can be verified that 

dM(K 0 ,dI<) = -[M(K 0 )]~'[dG(K 0 ,dK)H(K 0 ) + G(K o )dH(K 0 ,dK)][M(K 0 )]~ l . 

(A. 39) 

These results are important and give rise to a whole range of explicit expressions for 
dM(K 0 ,dK) for various matrix-valued functions M{K). However, we are not inter- 
ested in gradients of matrix expressions with respect to matrices. For the purposes of 
this research the goal is to find explicit closed-form gradients for scalar cost functions 
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with respect to matrices. All the above results are intermediate steps on the way to 
find such expressions for the defined cost functions. All gradient computations for 
these cost functions can, in one way or another, be transformed into forms that involve 
the trace functions. It is well known that the trace operator and the “d-operator” 
are interchangeable, that is dTrace[M(K 0 ,dK)\ = Trace[dM{K 0 ,dK)\. Hence the 
machinery developed above for matrix-valued functions will be applicable for this 
type of problem. For the derivation of explicit closed form gradient expressions we 
then utilize the important lemma by Kleinman for this type of function. 

Lemma A. 2.1 (Kleinman’s Lemma, [133]) 

Consider the trace function f(h ) = Trace{M(K)} where M(K ) is a quadratic matrix 
function of a matrix K 6 R rKs . Assume that M(K) is (in all entries) differentiable 
with respect to every element of K. Assume furthermore , that f(K 0 + dK) — f{K a ) 
can be expressed as follows. 

f{I< 0 + dK) - /(/Co) = Trace{D{I< 0 )dK). (A.40) 


(A. 41) 
(A. 42) 

A final remark to some notational convention used in this context. In many publica- 
tions the following notational system has been used for matrix differentials. 

M(K 0 + eAK) = M(K 0 ) + AM(I< 0 ,eAK) + e k R(AI<) 

= M ( K 0 ) + eAM{K 0 , A K) + e k R( A I<) 

for k > 1. This notation is easily recovered from the one used in this thesis by 
applying the following substitutions. 

dM(K 0 ,dI < ) -> eAM(K 0 , AK) 
dK AK. 


Then the derivative of f(K) at I< — I< 0 is given by 


WO. \r\( IS \1J 

q k \K=K 0 - [L>{Ko)\ 


where 


{[C(M T K,i = 


mn. 

dh'u 


, k = 1, 2, ...r, / - 1.2, 
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A. 3 General Differential for Trace {e^UOb/} 


In this section a brief derivation of a general expression for the differential of the cost 
function in chapter 4 will be formalized and presented 

with some details. Assume that M(K) is a real square symmetric matrix function 
of a parameter matrix A. Furthermore, A4(A) is assumed to be continuous and 
differentiable with respect to K. That is, we assume the existence of a dM(K 0 ,dK) 
that satisfies (A. 34). In the following let us assume furthermore, that tj is given 
and that all elements of A are independent. Then we can consider to be a 

function g(Ii) of A only, namely g(K) = Using a series expansion of the 

corresponding matrix exponential, g(K) can then be expressed as follows. 


g(K) = Trace{e [M{K ^>) 

oo jk 

= Traced MM(K)] k } 

k = 0 K ' 

oo -j. k 

= E ^rrace{[M(A')] 4 } 


(A. 43) 


k = 0 


and hence by neglecting higher-order terms in dl< and with K = K 0 + dl\\ 


g(K 0 + dK) = Trace{J2^[M(K 0 + dK)} k } 


oo -ik 

l L i 


k=0 


kl 

t k < 


(A. 44) 
(A. 45) 


= Trace{^-t[M(K o y+ dM(K 0 ,dK)] k } 

k = o K - 

oo jk oo jk 

= Trace{J2 i\M{K 0 )} k + £ ^k[M(K 0 )f~^dM(K 0 ,dK)} 

k = 0 k = 1 K - 

(A. 46) 




= g(K 0 ) + t f Trace{^[-£-—[M{I< 0 )]( k ' ] ]dM(K 0 ,dI<)}( A.47) 

k = i t ) ■ 


00 t‘ 


g(K 0 ) + t f Trace{J2{^(M(I< 0 )y}dM(K 0 ,dK)} 

i=o L 


(A. 48) 

= g{K 0 ) + t } Trace{e [M ( K °n i idM{I\ 0 ,dK)}. (A.49) 

Hence, for a given tj, we arrive at the following result for this type of cost function. 


dg(K 0 ,dK) = g(I< 0 + dK) - g(K 0 ) 

= t f Trace{e [M[K ^ l idM{K 0 , dK)} 


(A. 50) 
(A- 51) 
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and hence for = g(K): 

df[(K 0 ,t f ),dI<] = tjT race. { e l M ( A ’°)l ( / dM ( K 0 ,dK)}. (A.52) 

The only task left is the conversion of d,M(K 0 ,dK) into a form such that we can 
apply Kleinman’s lemma to derive explicit gradients. This task, however, depends on 
the specific structure of M(h) and results for some specific cost functions are derived 
in appendix B. 

A. 4 General Differentials of Eigenvalue Functions 

Based on the fact that the above cost function _/"(/{", fy) is expressible in terms of the 
individual eigenvalues X[M(K )]) and for various other constraints a brief review of 
eigenvalue differentials is included here. Let M[K ) be a real square (not necessarily 
symmetric) matrix function of a real parameter matrix 1\. For this general case 
we restrict our attention to the case where the eigenvalues under consideration are 
simple and differentiable at K = K 0 . Note that this is always true for a symmetric 
M(h ). Following the derivation in [67] let A 0 be an eigenvalue of M(K 0 ). In general 
this eigenvalue will be a complex number A„ = A or + j\ 0 , where the subscript /• 
denotes the real part, the subscript i the imaginary part and j = yj— 1. Let u 0 be 
the normalized right eigenvector of M(I\ 0 ) associated with the eigenvalue A 0 and v 0 
the normalized right eigenvector of M T (K Q ) associated with the eigenvalue A or — j\ 0 {. 
These vectors are in general also complex vectors u Q - u or + ju ol and v 0 = v OT + jv ot 
respectively. Note that the definition of v 0 implies that ( v or — ju ot )^ is the normalized 
left eigenvector of M(K 0 ) associated with the eigenvalue A 0 = A or + j\ oi . We have 
by definition: 


M(K 0 )(Uor +ju oi ) = (Kr + j\oi){u OT + ju oi ) (A.53) 

M {E 0 )(v 0 r + JVoi) = (A or — j\oi)(v or + jv oi ) (A. 54) 

(u or - JU 0 i) T {u 0r + JU 0l ) = (v or - j V ol ) T (v or + j V ol ) = 1 (A.55) 

for some eigenvalue A 0 of M(K ) at K = K 0 . With these definitions the differential 
d\[M(K 0 ,dK)\ can be expressed in the following form ([67], page 163). 


d\[M(K 0 ,dI<)} 


d\ r [M(K 0 , dK)} + jdX t [M(K 0 ,dK)] 


(A. 56) 
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(Vor - jv 0 i) T dM (K 0 ,dK)(u 0T + ju ot ) 
(Vor - jv oi ) T (u or + ju oi ) 


(A.57) 




Stability constraints and symmetric matrix inequalities involve only the real part of 
all corresponding eigenvalues, the imaginary part A ot - is irrelevant for such problems. 
Hence the differential d\ r [M(K 0 ,dK )] is required for this type of constraint or cost 
function, not d\[M(K 0 ,dK)\. By combining equations (A.56) and (A.57) and ex- 
amining the real and imaginary components separately (note M(I<) is a real matrix 
function of a real matrix and hence dM (A 0 , dh) is real), we arrive at the following 
linear system of equations 


d\ r [M(K 0 ,dK)]q 2 + d\i[M{K oy dK)]qx 
d\ r [M{K 0 , dK)]q x + d\i[M(I< 0 , dK)]q 2 

with the real scalars q\ and q 2 given by 


v T or dM(I < 0 , dK)u or + v T 0 l dM{K 0 , dK)u oi 

(A. 59) 

v JidM(K 0 , dK)u or + vJ r dM(K 0 , dK)u oi 

(A. 60) 


71 ^oi^or V or Uoi (A.61) 

72 T ^or^or' (A. 6^) 


The system (A. 59) and (A. 60) is readily solved for d\ r [M(K 0 ,dK)\ to yield the fol- 
lowing result for the differential of the real part of the eigenvalue. 

d\ r [M(K 0 , dK )] = — ^ 2 [vJ r dM(K 0 , dI<)u OT + vJ i dM(K a , dK)u oi 

( l\ "r ?2 

+ ^~[vldM(K (n dl<)u or - vJ r dM(K 0 ,dK)u o i (A.63) 


with 


= TraCe {[~r Z „2 ( U orvi + U 0l V T ol ) 

71 T- </2 

+ - u 0 i vJ r )]dM(K o ,dK)} (A. 64) 

71 ~r q-2 

= T race { Pd M (K 0 ,dK)} (A.65) 


P = 


*72 


*7i + 72 


2 (u or uJ r + ^oiV« ) + 


71 


7i + 72 





(A. 66) 
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Note that (q* + qf) is non-zero (see [67]). Hence we have arrived once again at an 
expression that is amenable to the application of Kleinman’s lemma once the structure 
of M(h) is known. Of course, this formulation is valid only if the corresponding 
eigenvalue is simple. In the affirmative case we have derived a nice characterization 
of the differential in terms of the corresponding eigenvectors of M{K a ) and [M(K 0 )] T 
respectively. 

The above expressions simplify considerably for the case when M(K) is symmetric. 
In this case all eigenvalues are simple for any K . Moreover, all the eigenvalues and 
eigenvectors are real, and u Q = v Q = u s . This implies that = 0 ,q 2 = u%u s = 1. 
Equation (A. 65) is still valid for the symmetric case and we have 

d\ r [M(K 0 ,dK)\ = d\[M(K 0 , dl<)} = Trace{u s u T s dM{K 0 , dl<)}. (A.67) 


Although we have taken a different approach to arrive at this result for symmetric 
matrix functions, this result compares nicely to theorem 7 in [67], p. 159. 

If the matrix-valued function M(K) under consideration is not convex, then the 
cost function Trace{e\ M ^ h ^ l f} is in general not convex either. This gives rise to a 
formulation for matrix inequality constraints M(K) < 0 in terms of the cost functions 
as defined in (4.13) or (4.15). In the following it will be shown, that gradients for 
these alternative cost functions can be found by minor modifications of the gradients 
for Trace{e\ M ^^ t i} without developing a whole new train of thought. Although 
this approach is applicable to general lion-symmetric matrix functions, here only the 
symmetric case is presented. At this point consider a q x q symmetric matrix function 
M(K) of a general real matrix K and the cost function f[M(K)]. 


fk[M(K)\ 


£A[m(/0] 

A;=l 

f t f (\ k [M(K)}) 2 if \ k [M{K)} > 0 
1 0 if\ k [M(K)] <0. 


The corresponding differential is easily found to be 


(A. 68) 
(A. 69) 


df[M(K 0 ),dK] 

dfk[M(K 0 ),dK] 


'Edf k [M(K a ),dK] 


k= 1 


(A. 70) 


2tj(\ k [M(K 0 )])dX k [M(K 0 ),dK] if X k [M(K 0 )} > 0 
0 if \ k [M(K 0 )\ < 0 

(A- 71) 
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which , with (A. 67), can be converted to 

df[M(K 0 ), dl<] = £ dfk[M(K 0 ), dl<] (A. 72) 

i=i 

df k [M{K 0 ),dK] = 

f 2tf(\ k [M(K 0 )])Trace{u k u[dM(K o ,dK)} if X k [M(K 0 )\ >0 
1 0 if\ k [M(K 0 )]< 0 

(A. 73) 

with 

M(K 0 )u k = X k [M(K 0 )]u k , ||t £ fc ||-2 = 1. (A. 74) 

Note at this point the structural equivalence between df k [M(K), dl<] in (A. 73) and 
df[(h 0 ,tf),dK] in (A. 52). 1 he only differences are the additional factor 2A k [M(K 0 )\ 
and the matrix u k u T k that substituted ei M ( A 7>)]</ j n df[(K 0 ,tj),dK]. Hence, if the dif- 
ferential of Trace{e\ M Ws) is known, the differential df k [M(K), dK] can be derived 
by the following scheme. If X k violates the desired inequality constraint, then 

df[(K 0 ,t f ),dI<] df k [M(K 0 ),dK] 

with the following substitutions in df[(K 0 , tf), dK]: 

tj -> 2(A k [M(K 0 )))tj 

e [M(a-)lq ^ UkU T 

to get the corresponding differential for the k th eigenvalue of M(K). The overall dif- 
ferential df[M( K 0 ), dK ] follows from the summation over the individual components. 
Hence the gradient computation for this type of cost function or for the cost functions 
in (4.13) can be derived directly from the gradients of the appropriate trace-function 
by simple substitution. 

A. 5 General Differentials of Functions Involving Grammians 

Some design constraints involve controllability or observability grammians. In general 
these constraints will be of the form 


f(K) = Traceie^^-Wi} 


(A. 75) 
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for some real constant symmetric matrix N and a real symmetric matrix function 
M(K) that satisfies 

A t (K)M(K) + M(K)A(K) + Q(K) = 0. (A. 76) 

Note that M(A) in this formulation does not depend explicitly on A\ rather, its 
dependence on K stems from the facts that A(K) and Q(K) are matrix functions of 
A. In general it is assumed that A(K) is a real square matrix function of A", that 
is continuous and differentiable with respect to K. Furthermore, A(K) is restricted 
to be asymptotically stable at A = A 0 and A = K 0 + dK . Q(K) on the other hand 
is a real symmetric matrix function of A that is also continuous and differentiable 
in A. Due to continuity of A(K) and Q(K) and the monotonicity property of the 
eigenvalues of symmetric matrices (see Weyl’s theorem) we can conclude the existence 
of an expression dM{K 0 ,dI\) such that 

M{K 0 + dK) = M{K 0 ) + dM{K 0 ,dK) + R(dK) 

as in (A. 34). Hence the machinery developed in equations (A. 44) through (A. 49) 
shows that 

df(I\ a , dK) = tfTrace{e [M{Ko) - N]t fdM(I< 0 ,dK)}. (A. 77) 

With the abbreviation E = this amounts to finding 

df(K 0 ,dK) = t f Trace{EdM(K 0 ,dK)}, (A. 78) 

subject to (A. 76). With the assumption that A(K) is asymptotically stable at K 0 
and A = h 0 -f dl\ , we can express M(K) in terms of an integral over an infinite 
time-horizon. 

M(I<) = limf e [A(K)]TT Q{I<)e A(K)T dT. (A. 79) 

Due to the continuity and differentiability assumptions on A(I<) and Q(I<), corre- 
sponding expressions dA(K 0 ,dK) and dQ(K 0 ,dK ) are also well defined. Using the 
fact [64] that 

e [A{k<,)+dA(Ko,dK)]t _ e A(h’o)t _|_ f £ A ( K o)(t-s ) q dK)e A ^ Ko>>S d$ 


(A. 80) 
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we arrive (after some algebra) at the following differential expression for the function 

/(A ) = 

df(K 0 ,dK ) = tfTrace{L x [2L 2 dA(K 0 ,dI<) + dQ(K 0 ,dK)}} (A.81) 

where L\ and L 2 solve the following Lyapunov equations, 

A(I< 0 )L\ + L x A t (K 0 ) + E = 0 (A. 82) 

L 2 A(K 0 ) + A t (K 0 )L 2 + Q(K 0 ) = 0. (A. 83) 

For more details on this procedure the reader is referred to [64] and [133]. Without 
further details it is clear that similar expressions can be derived for the case where 
M ( A ) solves 

M(K)A t (K ) + A(I<)M(K) + Q(K) = 0. (A.84) 

In conclusion, for this type of function we also end up with an expression (A.81) to 
which we can apply Kleinman’s lemma once the explicit structure of A(K) and Q{K) 
are known. 


A, 6 Gradients of Scalar Functions with Respect to Symmetric Matrices 


So far only gradients of scalar functions f(K) with respect to general matrices K have 
been considered. The case where K is symmetric needs some further elaboration. 
However, it can be shown ([90], chapter 10), that this special case can be reduced 
to the general case by use of theorem 10.1 in [90]. Under the usual continuity and 
differentiability conditions as above and the assumption that K enters f(K) only in 


matrix form (that is /(A) is not explicitly a function of individual elements of A), 
this theorem states, that for a symmetric matrix K — K r we have to modify the 
gradient expressions to account for this additional information as follows ([90]). 

df{K) 


dl< 


dfU<) df(K) df(K) 

+ — ~ ~diag{— dK } 


dl< 


0K T 


(A. 85) 


where diag { ^ } has the same main diagonal as ^ and zero elements elsewhere. 

Note that gradient expression of a scalar cost function with respect to a symmetric 
matrix is itself symmetric. With (A. 85) the gradient computation techniques devel- 
oped above are also applicable to this problem with some extra effort due to the 
additional terms in the overall gradient. 
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DERIVATION OF EXPLICIT GRADIENT 
EXPRESSIONS 

In this appendix we will provide a complete list of explicit closed-form gradi- 
ent expressions for all the cost functions and constraint functions used to solve the 
mixed '^/'^foo-control problem. The derivation and notation are based on the results 
presented in appendix A. For the general multi-plant case with output-feedback all 
gradients are based on a representation of the closed— loop systems in terms of the 
closed-loop system matrices defined in (3.17) which are repeated here for convenience. 


Ku 

= A % 

+ 

B' 3 C 0 C‘ 

Bit,; 

= B\ 

+ 

B' 3 CoDI m 


= c\ 

+ 

d\ 3 c 0 c * 

A cl,oo 

= 

= 


Bh,oo 

= 

+ 

32 

n* 

cl, oo 

= C\ 

+ 

D l C C x 

n* 

U cl, oo 

= of, 2 

+ 

/)* c /> 


and 

K = (7 ‘f I - D> cKx 

S‘ = (V) 2 / - 

The individual matrices A\ and so forth are defined in chapter 3. In the following 
gradient expressions are derived for the i tk plant condition only. Depending on the 
formulation of the actual optimization problem, gradient expressions for all n v plant 
conditions can be formed from these individual gradient expressions. Furthermore, 
the subscript “(*) 0 ” has been used in appendix A to denote the point at which 
the gradient is evaluated. This convention is dropped here in order to simplify the 
notation. Hence in the following (7 0 and X 1 are used instead of Co Q and X l Q respectively 
for simplicity. 
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B.l Hoo -Constraint Function Gradients - General Case 


In this section we consider the cost functions associated with the pure 77oo~problem 
and the corresponding cost/constraint functions in (5.1.1). The first cost function is 


f'ARl c . OF (Co,X\ 7 %) = Trace {e AR1 'c.o F ^^)t )l} 


(B.l) 


associated with the i tl1 plant condition. In the following, various intermediate steps 
are shown for the computation of the ARI-gradients. Because the intermediate steps 
require quite a complex notation, these details will be omitted for the other cost 
function gradients which can be derived using the same techniques. Two forms of 
ARIc,of(C‘ o,X\y) will be used in deriving the gradients with respect to C 0 and X’. 
They are the two equivalent forms of ARIq OF (Co, X', 7 ') given in (2.31) and (2.30). 
The formulation 


ARIb, OF (Co,X\Y) = (AiifX' + AM), + (Ci Loo ) T C' choo + KuAB'r\P' aux ) T (B.2) 


with 


PL = *' <„ + 


(B.3) 


provides a convenient form of A/?/^ 0 /r (Co, X\Y) for the gradient computation with 
respect to C 0 while 


ARIb,oACo,X\f) = (A\„) r x- + + X'B\„,X' + C'„, (B.4) 


with 


(B.5) 
(B. 6 ) 
(B.7) 

is more appropriate for the gradients with respect to X'. The gradients of (B.l) with 
respect to the matrix C 0 will be derived first. Note that for this derivation X i is 
treated as a constant. With the abbreviation 


bL = B' d , m (fe)-'(Bi,, x ) T 
CL = (V) 2 (Ci 0o ) 7 '(S')- , Q„ 


„ e Ml' cor (Co, 


( E ARI c ,of) T 


(B. 8 ) 
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the result in (A. 52) can be applied to the cost function (B.l) with AR.P C of (Cq, X\ 7 ’) 
as given in (B.2) to yield 


df: 


A Rl c , 




= t), Trace{ E\ RIcQF dA RIh tOF [{C Q , X\ 7 > ), dC 0 ] } 
= t X f}Trace{E' A 


'a R i c , UF ((Ci) T (dC 0 ) T (B' 3 ) T X' + X'B' 3 (dC 0 )C i 
WWWQ. + ((■'i,oo) T F>U<iCo)ci 

+[X‘Bi(dC,)bi a 4 (CmdC 0 )T(bi 3 )T 4 (Ci < ,,)’'D' 3 (rfC„)Q](fl')-'(/’^) T 
+rLM')-'[X‘mc,)Di, + (d) T (dc^(a 13 f + {c- d ^b’„(dc a )Ci\ T 

(B.9) 

For individual steps the reader is referred to the machinery developed in appendix 
A. In particular the linearity property, the product rule for matrix differentials and 
the explicit differential expressions for functions involving matrix inverses as given in 
(A. 38) and (A. 39) have been utilized to derive (B.9). After some simplifications and 
rearrangement we arrive at the more compact form 


df % ARl c ,oF X 1 , 7% tyi), dC 0 ] 

= it^Tracem + 


wn + m t , oof + pl 


ari c ,of (B.10) 

( pmmmD ^ dCo } 


and hence by applying Kleinman s lemma to this trace function the gradient of 
fARla.oF^ 0 ' with respect to C 0 is given by 




ARI C) of 


(C 0 ,X\Y,f„) 


dC 0 


+ D - 3t ( Hr '( PL ) T } E‘ AR , cor (B.11) 
1 x‘Bi + 4 rL(itr'(o , am ) T )t>‘j) T 


for the i th plant condition. Note that the computation of this expression involves only 
elementary matrix operations such as matrix multiplication, matrix addition and one 
matrix exponential for E) \rj cuf at each plant condition. Next the gradients of (B.l) 
with respect to X x are computed. At this point no symmetry assumption on X* is 
imposed. Later on it is shown how this symmetry constraint may be accounted for 
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explicitly as pointed out in chapter 5. 


( Vah1c.of 7% t'/i), dX l ] 

= t l } rj Trace{E\ RIc aF dARI l COF [(Co, X 1 ,X),dX 1 )} 

= ‘h Tracc { E ARlc.oM^) TdX ' + 'i-V-4^ + dX-B'^X' + X-B'^dX'}) 

= (>, r.-« ce {£i R , o()F (/l’„, + B^X-fdX 1 +dX'(A'„ m + B^„X-) T B\ Rhop ) 

= t’n Ti-ace{[E' A[iIcoF (A' nuj: + B' nux X') T + (A\ ax + B , aux X')E' ARIcuF ]dX'}. 

(B.12) 

Applying Kleinman’s lemma to this expression directly gives the desired gradient 
expression in a closed form. 


a/; 


ARl 


C,OF 


(C 0 , x\y, t\ x ) 


ox ! 


t'fAEARi C ' OF {A' aux 4 - B’ ux A r, ) T 

+ B' aux X')E' ARIcoF }. (B.13) 


Finally, for the problem of designing a Woo-optimal controller, gradients of the 
cost function /^/ c? OF (Co, X*,YA t fi) w >th respect to 7 * are required. Note that 
ARIc,of(('Oi 7 1 ) only contains terms in (7*) 2 . Hence, for this problem it is suf- 


ficient to optimize over (7“) 2 . Without further details and assuming all the above 
abbreviations it can be verified that 


VfluuC'oAC 0 ,x i 

d( 7 1 )' 2 


7\4) 


= -t' n Trace{{R')-\P l a 


y E\ RlcOF p: ux {R i r 1 }- ( b.uj 


Differentials for the remaining 77<x, -related constraint functions f' D (Co, 7*, t l j 2 ) and 
fxiX'it 1 / 3) * n definition 5.1.1 are treated next. Recall that 

fb(Co,l\t) 2 ) = Trace (B.15) 

fx(X\t) 3 ) = Trace {e- x ' l 'f>}, (B.16) 

and hence the corresponding differentials are as follows. 


df d[{P 0)7 ltjAidC'O — ■^f/2^ lr ’ aCe {^32Cp(/) c / i00 )^'/)23<fCo} (B.17) 


dfbKCo^bty^dX'} = 0 (B.18) 

#M(Co, 7 , ',^2)^(7‘) 2 ] = -t' f . 2 Trace{E' D d( 7 1 ) 2 } (B.19) 

dfx [V*, dCo] = 0 (B.20) 

<ir x [X\t)A,dX'\ = —fj 3 T race{E i x dX i } (B.21) 

dr x [X\t),),d(YY] = 0 (B.22) 
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where 


E l D = e E D £oo»h,oo-(V) 2 /]t} 2 (B.23) 

Ex = e~ XH t». (B.24) 

Kleinman’s lemma immediately gives the corresponding gradient expressions. For 
easier reference these gradient expressions and the above gradients for the ARI- 
constraint functions are summarized below. 


1- fiwc^C'yXW,*,,) - Trace. . 


a/s 


ARI C 


n(\, 


dX’ 

a(T) 2 


with 


[VB| + ((Ci, m ) T + P:,ART'(Di lm f)D' 13 }) T 

(B.25) 


t )A E ARIc.or(K«,+ B‘^X') T 

+( /1 S UI + Kux^') E Am COF ) (B.26) 

-t),Trace{(Rr\PL,) T E\R, c . 0 ^AK)-') 

(B.27) 


ARIc'Of(C 0 , X\Y) 

= (•4L) T v + xMi„ + x'BL.x' + c:„ 

w 

= (i? 1 If am 

S' 

= (V)*/ - r>i,,^D' dm ) T 

A 1 

n aux 


R l 

D aux 


O’ 

v aux 

= (Ync^wr’a^, 

p i 

aux 

= x-b;, i00 + (c;, i00 ) t d;, i00 

E'aRIc.of 

= f/' RI ',::.ui K.o.XWIi;, 

i 

1,2, /ip. 
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2. P D {C 0 ,y,t' f2 ) = Trace {e [D *l°° D k°° J. ; 

(B.28) 
(B.29) 
(B.30) 

with 

E' d = 

i 1 1 2, . . . , iip. 

3 . A(X‘,t%) = Trace 


^ f2[^^'2Ep(D c ^oo)' r D 23 ] 


= -t) 2 T r ace.{P D ) 


with 


(B.31) 
(B.32) 
(B.33) 

E\ = e~ XH h 
i = 1 , 2 ,..., n p . 


3) 

dC 0 

vjx^ljA 

dX' 

d(~y % ) 2 


= 


BAA Modification of the Gradient Expressions for Symmetric X 1 

Note that for the gradient expressions as derived in the previous sections, the fact 
that all X 1 are symmetric has not been used. The discussion in chapter 5 shows that 
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the optimization can be performed over a set of n p upper triangular matrices X 1 


X[.i 

X\,2 

XU • 

yi 

1 ’( n jr* + n c _ 1) 

yi 

^ l»(« x i +n c ) 

0 

XU 

xU • 

yi 

* yv 2 1 (n st +n c -l) 

yi 

^2,(u x , +u c ) 

0 

0 


Vi 

Vi 

^ 3 >( n x*+ n c) 

0 

0 

0 

yi 

^ (n xt +?i c -l),(7i. pl +7i c -l) 

yi 

^(n^+nc-lM 

0 

0 

0 

. 0 

(n xl +n c ),(7i xl 


from which the matrices X 1 are formed by X' = X' -f (X') T - diag[X'} or X 1 = 
{X l ) T X 1 . In the following discussion the function /aRIc.of ^ > s used 
as an example to illustrate the necessary modifications to account for one of these 
factorizations. These modifications are easily applied to the other relevant functions 
and their gradients. Also, note that the gradient expressions for (7 0 are not affected 
by a particular form of X{ and remain unchanged. 

Let us first assume a factorization X' = X % + (X’) T — diag[X'\. The cost function 
becomes 

fAR, c , aF (C 0 ,X\Y,f n ) = r ARIcoF (Co,X i = X' + ( X') T - dtag[X'],y,t' fl ) 

Now gradients with respect to X % have to be computed. Following the derivation of 
dfARi C:OF [{Co, X' <iX'] in (B.12) it can be shown that 


^ARIc^iCo, X\ d fAR lc , OF (C O'XWh) 

dX i d(X i ) T 

and hence, by invoking (A.85), the gradients of f t AR]cOF (C 0 ,X i ,j i ,t i f ^ with respect 
to a symmetric X' amount to 

d f l ARl Ci 6 F ( C 0 ’ X \ 7 ‘> */i ) 0 dfARi c OF ( C o> </i ) 

ale = 2 

dx i 1 

(B.36) 

This expression gives rise to the following gradient expressions with respect to X': 
df i ARi c , OF {Co*X i , _ M RhtOF (Co,X\Y,th) t 




\X'={X') T ik,l 


(B.37) 
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for k — 1,2, ...(n x > + ra c ), / = k + m, m = 0, l,...,^ + n c — k. However, due to 


the fact that ari <- : , of 


.(Co.Jf'.V,*),) . 


dX' 


is a symmetric matrix, an equivalent expression for 


these gradients can be defined in terms of (B.13) as follows. 


WaricoA 0 0 >XW>th) 


dX 


= < 


k,l 


.8/1 


ari c,of 


(C 0 .X'n\t' n ) 


ax i 


k,i ij k — l 


(B.38) 


Of' nr (C 0} X\y y t\A 
2f -,* /c ' OF V lfk< i 


ax * 


for A: — 1, 2, + n c ), / = k + m = 0, l,...,n.pt -f — A. Note that such an 


equivalence may not be possible if 


^r ARIcoF {Co, x \i\t),) 

ax* 


is not a symmetric matrix! 


However, symmetry does hold for all the cost functions and their gradients with 
respect to X\ Hence (B.38) is equally applicable to all the other functions considered 
here. 


Numerically both expressions are equivalent. Computationally the formulation in 
(B.38) is more effective since it requires less matrix operations than that in (B.37). 
Mathematically, however, (B.36) and hence (B.37) represent the correct gradient ex- 
pressions for the considered factorization. 


Alternatively, symmetry of X % can be imposed by optimizing over the Cholesky 
factor X x of X 1 = {X l ) T X z , Note that the desired gradients of 


/W,„(C 0 ,x‘ = (x < ) T x\Y,r„) 


with respect to X 1 do not require the special treatment for symmetric matrices as 
above. X % can be considered a general square matrix and the gradient expression 
will contain the gradients with respect to all the elements of X' . Of all of these 
individual gradients, the gradient-based optimization utilizes only these gradients 
that correspond to a non-zero element in X'. For this parametrization the partial 
gradients with respect to X' are easily derived from (B.13). With Kleinman’s lemma 


C-3 



and equation (B.13) the following expressions can be derived. 
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— Vj^Trace 


{[ 


9/V 


jCjOF 


(Co.xW.^) 


dX' 


) T [{dX') T X' + {X') T dX'}} 


(B.39) 


= 2 t l j x Trace{[ 




3X' 


(X-) T dX']} 


Hence, by application of Kleinman’s lemma, 


o/Wo-ev** = (^ , ) r -y , .7 i ,«>i) „o i drAR lc . or (.C',xw,r„) 

dX' dx * 


(B.40) 


Thus the gradients with respect to X 1 differ from the gradients with respect to X 1 
only by the multiplicative factor 2X\ This is generally true for cost functions that 
depend on X 1 with X 1 as the optimization variable and X 1 = ( X') T X l . In either case 
the gradients with respect to X x can be derived from a modification of the gradients 
with respect to X 1 . 


B.2 Tii-Performance Cost Gradients - General Case 

This section is devoted to the gradient computation of the ^ performance cost 
functional J 2 (Co,f/x 2 ) defined in definition 3.2.1. Gradients for the most general 
finite-time case have been derived in [64] and are not repeated here. The gradients 
as presented here require an internally stabilizing controller C 0 such that the n p 
closed loop system matrices A' c [ are stable. Thus the limiting case of t}-H 2 —■ y 00 
can be used to derive the necessary gradients. As in the last section attention is 
restricted only to the i t>l plant condition. The overall gradients can be obtained 
from the summation over all the plant conditions. Note that this cost function is 
independent of the parameters X 1 and 7 *. Hence only gradients with respect to Co 
have to be computed. For this case the i th cost function is 

00 ) = ./'(Co, t, /k 2 ) 


(B.41) 

(B.42) 
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lim 


T race 




T AK,) T ‘ 


(Q,4 


'C‘,, 2 e A -‘‘ 


B'« 3 dt) 


= Trarnm,,,) T LiB^dt) 

= Tvace{B' d2 (B' d3 ) T L' 0 ) 


(B.43) 

(B.44) 

(B.45) 


where L 0 solves 

Mifii + L‘X, + (Ci,a) T C dd = 0. (B.46) 

Applying equations (A. 79) through (A. 83) in appendix A we obtain the following 
differential expressions. 


dJ' 2 [(C 0 ,oo) 9 dCo] 


= 2rrace{i;(i‘B;(rfC„X?j + (C;,, 2 ) r fi‘ 3 (rfC„)Q]}(B.47) 
= 2rrace{C‘i|[L‘Bj + (C‘, 2 ) T ByrfC„} (B.48) 


with 


K,L\ + L\(A‘ d ) T + B< da (Bi, d ) T = 0 

44 + (4) T ii + (c:, i2 ) r c; u = 0. 


It follows that the gradient expression is given by 

■ *<^414^ + (ci. 2 ) Tfi y > T 

For more details on the derivation the reader is referred to [64]. 


(B.49) 

(B.50) 


(B.51) 


B.3 Gradients for the Full State-Feedback Case: Continuous-Time Domain 

This section contains gradients for the state-feedback case as considered in chapter 6. 
With the controller factorization Co = W X~ l and the abbreviations given in chapter 
6 we need to find the partial gradients of 

J- 2 ,sf{W,X) = Trace{C c i- 2 XCj l2 } (B.52) 

= Trace{[C, + D, 3 WX-']X[C, + D, 3 WX~'] t } (B.53) 

and 


Joo,5fWX,7,f/i,t/3) - 7>ace{ e ^c,s F (W,Xa)t n + e ~Xt , , } 


(B.54) 
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where 

» 

ARIcMWX, 7) := X[A + B 3 W X~ x ] T + [A + B 3 WX~ x ]X (B.55) 

+1~ 2 X[C 2 + D 23 WX~ x ] T [C 2 + D 23 WX~ x }X + B,Bj 

with respect to W and X. Using the tools in appendix A, the following differential 
can be derived. 


dJt,sF[{W,X) t dW] 


Trace{D^{dW)X~ x XCj l2 + C cl , 2 X X~ x {d\V) T Oj 3 } 

2 Trace{C]l a D l3 (dW)}, (B.56) 


and hence, by applying Kleinman’s lemma, we obtain 


dJ2, SF {W,X) 

d\v 


2 dLc, 


13 


Equivalently, for the partial gradients with respect to X we have 


(B.57) 


dJ 2 , SF [(W,X),dX} = Trace{-D r ,WX- x (dX)X-'XCj l2 + C c i a {dX)Cj,. 2 

-C cl;2 XX~ x (dX)X- 1 XW T Dj 3} (B.58) 

= Trace{[CjC n - X~ x W T D^D^W X~ x ){dX)} (B.59) 

and 

= cfCx - X-' l W T Dj 3 D 13 WX-\ (B.60) 

As X) is not a function of 7 , the corresponding partial gradient is zero. Now 

consider the cost function J 00 ,«jf(W / , X, 7 , tji, tj 3 ) for fixed tyj and tj 3 . Applying the 
same machinery as before to the problem at hand, the following gradient expressions 
can be derived. 


(d doo , .s’F ( W, X ,7? ^71? f/3) 
mu 

&/qo, Sf(W, .Y, 7,^/i,f/ 3 ) 

av 

a/00, SF(W, V; 7 > £/1_t ^3) 

a 7 2 


+ r 2 D^(C 2 X + D 23 W))E ar1csf (B.61) 

*/i{ [3 + 7" 2 (C 2 X + + (B.62) 

+ 7“ 2 (C 2 X + D 23 JU) T C 2 ] T } - f /3 e- x< /3 

-</i 7' 4 r race{EARi CS!F XCj loo C c i <00 X } (B.63) 


where 


Ejuucsr = 


(B.64) 
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Hoc AND MIXED ^/^-DESIGN PROBLEMS WITH 
MINIMUM FEEDBACK GAIN: THE 
STATE-FEEDBACK CASE 

C.l Introduction and Problem Formulation 

Optimal 7Yoo-controllers may exhibit large feedback gains, resulting in large control 
efforts and increased noise sensitivity. Thus suboptimal controllers are normally pre- 
ferred, since they do not usually exhibit these undesirable properties. However, the 
problem of high-gain occurrence may arise even in the suboptimal 7^ tX) -design case 
and the mixed ^/Woo-design problem when the 7~foo _ bound is too tight. Here the 
problem of designing a minimum gain static full state-feedback controller is consid- 
ered for the same class of single-plant systems S 2/00 t op,SF as m section 6.2.1. 

x(t) = Ax(t) + B\iv(t) + B 3 u(t) 

z 2 (0 — Cia:(<) + D\3u(t) 

Zoo{t) = C 2 x(t) + D 2 3 u(t) 

y(t ) = x(t) 

with the same signal interpretations, signal dimensions and assumptions stated in 
section 6.2.1. Note that a non-zero direct feedthrough matrix from w(t) to Zoo(t) can 
be incorporated into this framework as well. However, without loss of generality we 
assume this feedthrough matrix to be zero (see section 6.2.1). 

For this type of systems a stabilizing static state-feedback gain Co = D c is sought 
such that the (nominal) Froebenius-norm of the feedback-gain matrix ||Co||f = 
yjTrace{ C qCq } is minimized and an Woo-constraint on the closed-loop transfer func- 
tion Too(Co, 5) from tu(.s) to Zoo(s) is satisfied. With the cost function (4.4) in chapter 
4 and the discussion in chapter 6 it is clear that the Woo-bound can be replaced by 
a scalar convex cost function utilizing the controller parametrization C 0 = WX~ l in 
[58]. However, the factorization Co = W X~ l renders the criterion for the Froebenius- 
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norm ||H^X _1 ||/r of the feedback-gain matrix non-convex. By minimizing an upper 
bound for this cost, however, the problem can then be cast into a finite-dimensional 
optimization problem that is jointly convex in W and X. Finally it will be illustrated 
how to apply this theory to the mixed -control problem with minimum gain 

considerations where additional ^-performance specifications are considered for the 
transfer function T 2 (C 0 ,s) from w(s) to z 2 (.s). 

Given a static state-feedback matrix Co, the closed-loop system E 2 /oo,c/,Sf’ is given 
by (6.23). For S' 2 /oo ,d,$F the design objective of a minimum gain TY^-problem is then 
defined as follows: 

• Design Problem PI: 

Find a stabilizing state-feedback gain matrix C 0 such that ||T 00 ((7o)||oo < 7 and 
(an upper bound for) ||(7o||f is minimized. 

We also address the problem where ||(7 0 ||f is not actually minimized but bounded 
from above by a certain prespecified value 6 F . Hence we can define an alternate 
criterion as follows: 

• Design Problem PF: 

Find a stabilizing state-feedback gain matrix C 0 such that ||r oo (C 0 )|| O o < 7 
and ||(7 0 || f < b c . 

The mixed H'l/'Hoo -control problem with minimum gain can be put into the following 
form: 


• Design Problem P2: 

Find a stabilizing state-feedback gain matrix C 0 such that ||7 1 00 (Co)|| 0 o < 7 and 
an upper bound for the weighted sum of ||72(Co)|| 2 and ||Co||f is minimized. 

Similar to the objective in PF we can also include design objectives where bounds 
are imposed on ||T2(t7 0 )|| 2 and/or ||<7 0 ||f- These cases will be outlined later. Note 
that all problems involving an H tJO ~ bound have a solution if and only if the associated 
pure T^oo-problem has a solution as shown in [140]. Design strategies that include 
either a bound on \\C 0 \\f as in PF or a bound on ||r 2 (C 0 )|| 2 such that ||r 2 (Co)|| 2 < b 2 
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may not have a solution even if the corresponding pure TY^o-bound problem has a 
solution. Note that with the above problem definitions the term “performance” can 
refer to either a pure ^-criterion, the Froebenius norm of the state-feedback gain, 
or a weighted sum of both. In general all the above objectives will also reduce the 
control effort according to INI* < IIColHMh. 

With the controller factorization Co = WX~ l , X = X T !> 0 and the results in 
section 6 . 2.1 it is clear that the -bound can be replaced by an A R 1 inequality 
and hence the scalar criterion 

lim Trace { e ARl c,sFWX,i)t Jl , = q ( C . 2 ) 

t fl -> oo 1 J y 

where ARJc,sf(W, X, 7 ) is defined in (6.29). An upper bound for the T^-norm of 
T 2 (Co, .s) is given by X) in (6.31). Furthermore, given a tji, both X) 

and Trace { e ARIc ' SF ^ w%X '^ 1 ^) are jointly convex in W and X . 

The cost associated with the Froebenius norm of the state-feedback gain ma- 
trix C 0 = W X~ A on the other hand is not convex. Hence in order to arrive at an 
optimization problem that is jointly convex in the design parameters, one has to ei- 
ther find a different controller parametrization for the controller C 0 such that all the 
relevant cost functions are convex under this new factorization. This is in general 
a difficult problem. Alternatively one can maintain the factorization Co = WX~ } 
for which Trace{ e ARlcsF ^ W ' X ^ t ^ 1 } and J 2 ,sf(W, X) are known to be convex and 
(similar to the upper bound for the 7Y 2 -cost) define an upper bound for the gain 
criterion ||VFX -1 ||^ that is also jointly convex in W and X. Furthermore, this upper 
bound should be as tight as possible to the true cost ||VTA r ~ 1 ||/r to avoid unnecessary 
conservatism. In the next section such a convex upper bound for || WX~ l ||/r is de- 
fined that allows the formulation of the above objectives in PI, PI’ and P2 as convex 
optimization problems. 
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C.2 Convex Upper Bounds for || W X~ l 1 1 /.■ 

Theorem C.2.1 

Consider the Froebenius norm of the state-feedback gain matrix ||(7 0 ||f = || WAY -1 || F 
with X = X T > 0 and a positive scalar t, then the two scalar functions 

■Jbi(W,X,t) = ]-T i \{X-') + \-Tract{W T W) (C.3) 

Z* Zd 

Jb 2 {W, X,t) = -Trace{r 2 X~ l ) + \-Trace{W T W) (C.4) 

with t 2 X > I represent upper bounds for || VK A' -1 1|^ such that 

I|W* -, ||f < J bi (W,X,t) < J B2 (W,X,t). (C.5) 

Furthermore, J B1 (W,X,r ) and ,J B2 (W, X,t) arc jointly convex on W , X = X T > 0 
and t > 0 . Moreover , an equivalent form for r 2 X > I is given by the matrix inequality 
constraint — X < 0? which is jointly convex on X — X T > 0 and r > 0. 

Proof: The following chain of inequalities proves that Jb\{ W, X, r) and J B2 {W,X,t) 


represent upper bounds for UVEA" -1 ||p. 


\\WX-'\\ F = 

jfrace(WX-'X-'W T ) 

(C.6) 

< 

\Jt race{T 2 X~ l W T W) 

(C.7) 


s. t. t 2 X > I 


< 

\J t 2 \{X~ x )T race{W T W) 

(C.8) 

< 

T 2 A(A r - 1 ) + l -Trace{W T W) 

Zd Z 

(C.9) 

< 

~Trace{T 2 X ~ ’) + \-Trace(W T W) 

Li Z 

(C.10) 


provided that — X < 0. Obviously equation (C.9) is equivalent to J B \{W,X,t) 
and equation (C.10) represents J B2 (W, X, r). Equation (C.7) follows from (C.6) by 
the scaling of ||VCA' -1 ||f with t 2 X > /. (C.8) follows from (C.7) using lemma A. 1.2 
in appendix A. (C.9) follows from (C.8) using the arithmetic-geometric mean in- 
equality with o=| and the facts that \(t 2 X~ 1 ) > 0 and Trace(W T W) > 0 (see 
appendix A). J B \(W, X, r) < J B 2 {W,X,t) finally follows from A (Z) < Trac.e(Z) for 
any symmetric positive-definite matrix Z. Convexity of Trace(W T W ) is shown in 
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appendix A (see lemma A. 1.7) along with the other convexity proofs (see theorems 
A. 1.2 and A. 1.3). As the sum of convex-valued functions is convex, overall convexity 
follows. ■ 

Unfortunately no explicit expression for the gaps between the desired cost ||Co||f = 
||WCY ^\\p and the upper bounds Jb\{W, X, r) and Jb 2 (W, A\ r) have been found. 
However, the additional constraint t 2 X > / is not only necessary for «/#i(W? X, r) 
and X , r) to be upper bounds for ||VUA r_1 ||^, the additional optimization vari- 

able t can be used to reduce the gap between the expressions (C.6) and (C.7) and 
hence the gaps between ||iyA r_1 ||/r and the upper bounds. Note that ^7 — X < 0 is 
equivalent to t 2 X > 7. The constraint -^1 — X < 0, however, is jointly convex on 
> 0 and r > 0 while no proof for convexity of r 2 X — 7 > 0 has been found 
at this point. 

Both bounds are continuous in W, X and r. The function J B \{W,X,t) is obvi- 
ously a tighter bound than Jb 2 {W, X, r). However, Jb 2 (W^X^t) is differentiable for 
all W,X = X T > 0 and t > 0 while Jb\{W, X, t ) is not differentiable at points where 
A(A r ~ 1 ) = A^A' -1 ) = A^A^ 1 ), i / j. This property is important in the numerical 
solution of the minimization problem. Convexity of the cost functions Jb\(W, X,r) 
and Jb 2 (W, X, r) now allows us to redefine the design objectives PI and P2 in terms 
of constrained convex optimization problems. Using the upper bounds derived above, 
the cost function representation for the Hoo-bound, the constraint ^1 — X <0 and 
the upper bound for the 77 2 -cost, the design objectives can be reformulated as follows. 

• PI: Minimum Gain Control with an Tfop-Bound: 

min J p1 (W,X,t) (C.ll) 

W , A ,T 

Jp\{W, X, r) = J Bi (W, X , r), i = 1 or 1 = 2 
subject to 

t lirn^ Trace { e ARI c,sr(w,x,i)t fi j _ g (C. 12) 

lim Trace {e { ^'~ x)tf2 } = 0 (C.13) 

lim Trace {e“** /3 } = 0 (0. 14) 

tf 3 — *CO V 

t > 0. (C.15) 
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• P2: Minimum Gain Mixed T^/TCxj-Control: 


min J P2 {W,X,t) (Cl. 16) 

WiXyT 

Jp-z(W, X , r) = ftJ Bi (W, X, r) + (1 - 0)J 2 ,sf(W, X ), 

i = 1 07’ 7 = 2 

subject to 

lim Trace { e ^c, = 0 (C.17) 

t/1— OO 1 1 V ' 

lim Trace ie^ l ~ x l t f 2 \ = 0 (0. 18) 

^ lim Trace {e~* (/3 } = 0 (C.19) 

r > 0. (C.20) 

where ft € [0, 1] is a weighting factor. For ft = 0 only the (nominal) Tii 
performance measure is taken into consideration, with ft = 1 the (nominal) 
minimum gain control problem is addressed. 

Design objectives such as ||Co||f < be or | j T2 ( C7 0 ) || 2 < b 2 can be incorporated in terms 
of «/fii(VF, X, r), i = 1 or i = 2 and with the additional constraints 


J B i(W,X,r) < b c , * = 1,2 (C.21) 

J-z,sf(W,X) < l>2 ■ (C.22) 

These constraints in turn can be replaced by the equivalent scalar representation 

lim^ Trace = 0) { = l2 (C.23) 

t lira i^Trace {e [j2 - SF{w ’ x) ~ h]t f & } = 0, (C.24) 


which can be appended to the above optimization problems. These objectives, how- 
ever, are not investigated further in this work. 


('■■} Numerical Treatment and Gradient Expressions 

The function X, r) is generally not differentiable. Hence, if one chooses this 

function as the upper bound for the minimum gain problem, Ellipsoid or Cutting- 
Plane methods have to be applied to solve the problem at hand. For the numerical 
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example the upper bound Jb 2 {W, X, r) has been chosen. This cost is differentiable 
as long as X > 0 and r > 0. Hence, gradient-based methods can be used to solve 
the optimization problem using this cost function. However, the constraints X > 0 
and t > 0 are continuity constraints in this formulation and have to be satisfied 
throughout the optimization (see the discussion in chapter 5). 

Algorithmically the problem can be solved in the same fashion as the mixed 
^ 2 /^ 00 -problem in chapter 6. That is, it can be solved iteratively as a sequence 
of constrained optimization problems or, by introducing an overall cost function, as 
a sequence of unconstrained minimization problems. The reader is referred to the 
discussion in chapter 5 and chapter 6 regarding this procedure. Using the tools de- 
veloped in appendix A, the following gradient expressions can be derived. 

1- Jb^W, X^ t) = |rrace(r 2 A'~ 1 ) + | Trace(lV T W ) : 


d. J B 2 (W,X,t) 

ow 

djB2 (W,X,T) 

dx 

djB 2{W,X,T) 

dr 

2. Trace : 


d Trace 

8W 

d Trace {e^ 7- *^ 2 } 

Jx 

3 Trace {e^ 7- *^ 2 } 

dr 


w 

(0.25) 

-~r 2 X~ 2 

2 

(C.26) 

Trace(rX~ 1 ) 

(C.27) 


0 

(C.28) 

£N 

1 

-h. 

1 

(C.29) 

_2 til 

r 3 

(C.30) 


All other gradient expressions necessary to solve the above optimization problems 
(( •11) ~ (('-15) and (C.16) - (C.20) for i = 2 can be found in appendix B. 
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C.4 Example 

To illustrate this approach, consider the 4 -order system used in [101] and in section 
6.2.1. It represents the scaled subsystem of the lateral dynamics of a B-767 aircraft: 


A 


( —0.0168 0.1121 0.0003 -0.5608 \ 

-0.0164 -0.7771 0.9945 0.0015 

-0.0417 -3.6595 -0.9544 0 


V 


o 


B\ = 


0 

/ 1 \ 
0 
0 

V 1 / 


B* = 


1 0 

t -0.0243 ^ 
-0.0634 
-3.6942 
0 


\ 


Cx = ( 0 0 1 0 ) , D 13 = 1, 


C -2 = ( 0.01 0 0.01 o), Das = 0 . 01 . 


The open^loop system is stable and the subsystem ^(^.s) has invariant zeros in 
the right-half plane. The minimally achievable ||r oo ((’7o)|| 00 is approximately 0.007 
and the minimally achievable T^-norm 1 1 ) 1 1 2 is 0.0078. 

In Figure C.l two curves are plotted. The design points on the upper curve (‘o’) 
represent the achieved controller gains ||Co||f — ||VPX _1 ||f by solving the convex 
optimization problem PI defined in (C.l 1) - (C.l 5) with X, r) as performance 

cost for a given Koo-bound 7 spec . The design points on the lower curve (‘*’) represent 
the resulting ||Co||f by solving the non-convex optimization problem P* rue : 

mm||C°|| F (0.31 ) 

subject to : [| T , oo (C r 0 ) ||oo < 7 spec (C.32) 

in terms of the trace cost function associated with the general matrix inequality 
ARIc(Coi Xilspec) < 0 (see chapter 5). Hence no particular parametrization for Co 
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is assumed for the design points on the lower curve in Figure C.l. Both curves show a 
typical behavior for mixed performance/robustness design objectives. For large 7 spec , 
II^oIIf is very small. If the overall problem becomes unconstrained in terms of the 
Woo- constraint, that is, if j spec is chosen large enough, ||(7 o||f will converge to zero 
for both design curves (as the open-loop plant is stable for this example). For small 
7 spec, on the other hand a dramatic increase in the controller gain can be observed in 
both cases. The difference between the two curves illustrates the conservatism of the 
upper bound X, r) in comparison to the “true” (non-convex) optimization 

problem P< rue , where no specific controller parametrization and no upper bound for 
IK?o||f was used. Note that the corresponding controller gains are plotted versus 7 spec 
and not the achieved / H 00 -norm ||7 1 oo (C 0 )|| oo . For small 7 spec the achieved ||7 1 oo (C 0 )|| oo 
is equal to the specified TCo-bound. However, for large 7 5pec this is no longer true. 
In these cases the achieved ||7 1 oo (C7 0 ) were strictly smaller than 7 spec , confirming 
the conservatism of the bound characterization ARIc } sf{C 0 = WX 1 , 7 ) < 0 in 
terms of W and X as discussed in section 6 . 2.1 

Figure (7.2 shows the conservatism of the upper bound Jb'i{W , X, r) (upper curve, 
‘x’) that was used as performance cost in problem PI in comparison to the actu- 
ally achieved norm of the controller gain UVFX -1 !^ (lower curve, 'o 1 ). Note that 
Jb 2 (W,X, t) and |J 14^ ~ 1 1| are plotted on a logarithmic scale, showing that the 
convex upper bound Jb 2 {W, X, r) for ||W r A'~ 1 ||F is rather tight for all design points. 

Figures C.3 through C.5 show results related to solving problem P 2 , namely 
the minimum gain mixed H^/T^oo-control problem. In figure C .3 two design curves 
1 1 T ‘2 ( Cq ) 1 1 2 versus ~f spec are shown that correspond to the design objective in P2 with 
Jb 2 {W, X , r), ft = 0 (pure ^-problem, lower curve, ‘ 0 ’) and ft — 0.5 (mixed 
control with minimum gain, upper curve, '*’) as performance costs respectively. Fig- 
ure C.4 shows the corresponding controller gains for these design cases. The curves 
in Figures C.3 through C.5 again display the typical tradeoff characteristics between 
performance and stability robustness where performance in this case can be either the 
^-objective 1 1 jp 2 ( C7 0 ) 1 1 2 , the controller gain yiTX -1 ||p, or a weighted sum of both. 
It is dear from these figures that for 0 = 0 the best W 2 -norm characteristic (as a 
function of ~f S p ec ) is achieved. For 0 = 0.5, when the controller gain is taken into 
consideration, the W 2 -performance worsens which is reflected by larger W 2 -norms 
||r 2 (Co )|| 2 for 0 = 0.5 in comparison to those for 0 = 0. The resulting controller 
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gains on the other hand exhibit the reversed behavior (Figure C.4). This result is 
expected and it is further illustrated in Figure 0.5 where plots are shown correspond- 
ing to the achieved controller gains for the design objective P2 with J B 2(W,X,r) y 
ft = 0 (P ure ^-problem, upper curve, ‘o’), ft = 0.5 (mixed H 2 /Woo~control with 
minimum gain, center curve, V) and ft = 1 (^-constrained minimum gain control, 
lower curve, ‘ + ’) respectively. Figure C.5 illustrates that an increase in ft implies a 
decrease in the controller gains. Note also that for ft = 1 (lower curve) the controller 
gains converge to zero for large 7 spec . This is due to the fact the the open-loop sys- 
tem is stable. Hence if - f spec is larger than the open-loop norm ||T 00 (Co)||oc, a 
controller Co = WX 1 with W = 0 will “stabilize” the plant and satisfy the speci- 
fied 7Yoo-bound implying HWCY -1 ||p = 0. If 7Y 2 -objectives are incorporated [ft — 0, 
ft — 0.5), then the controller gains do not tend to zero for large 7 spec as in this case 
the additional performance cost corresponding to ||7 2 (Co)|| 2 would not be minimal. 

The actual choice of the controller depends on the chosen performance specifi- 
cations in terms of the controller gains and the 7Y 2 - performance cost as well as the 
necessary 7^ (XJ -robust stability requirements. 



IIT 2 (s)II 2 


Figure C.2: 'H <x > -const rai ned minimum gain problem PI with Jb 2 {W, X, r), Co = 
WX [3 = 1: IIVFA'" -1 ||f (‘o’) and the upper bound Jb 2 (W, X, r) (‘x’) versus the 
specified TCo-bound 7 Jpec . 



Figure C.3: Mixed -control with minimum gain: ^/robustness tradeoff 

characteristics: ^-performance versus specified ft^-bound 7 spec ; Problem P‘2 with 
JfiiiW, X, r), (3 = 0 (‘o’) and [3 = 0.5 (V). 




Figure C.4: || WX 1 ||/r versus specified ft^-bound j spec - mixed Hi/Ho 0 -control with 
minimum gain; Problem P2 with JsiiW, X,t), ft = 0 (‘o’) and ft = 0.5 (V). 



Figure C.5: \\W X ’Hf versus specified ft^-bound 7 „ pec ; mixed H 2 l'H 00 -contro\ with 
minimum gain; Problem P2 with J B2 (W, X, r), ft = 0 (‘o’), ft = 0.5 (V) and ft = 1 
(*+’)• 
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ROBUST STATE-FEEDBACK CONTROLLERS FOR 
SYSTEMS UNDER MIXED 
TIME/FREQUENCY-DOMAIN CONSTRAINTS 

In this appendix the tools developed in chapters 4 and 5 and in appendix 0 are 
applied to design problems that involve time-domain constraints on the control ac- 
tion and the closed-loop system state as well as frequency-domain 'ftoo-constraints. 
The problem is formulated in the discrete-time domain and hence extends further the 
results presented previously. In order to emphasize the discrete-time domain in this 
appendix, all signals are identified accordingly, i.e., x(k) or u(k). Associated transfer 
functions in this domain are identified by their dependence on the variable of 
the ^-transform. For related norm-definitions of discrete-time signals the reader is 
referred to [62] or [72]. 

In the following discussion a system G D) denotes a linear, shift- 

invariant, discrete-time system 

G .{ *<*+!) = Ax{k) + Bw(k) 

| y(k ) = Cx(k) + Dw(k) 

Such a system G := (A, B,C, D) is asymptotically stable if all the eigenvalues A, of 
A satisfy |A,| < 1. The TYoo-norm for a discrete-time system G := (A, B,G, D) is 
defined as 

||C(2)||oo = sup a[G(z = e 39 )] (D.2) 

0£[O,27r] 

where G(z) is the transfer function from w(z ) to y(z) associated with the system 
G:= (A,B,C,D). 
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D.l Introduction and Problem Formulation 

A large number of control problems require designing a controller capable of achiev- 
ing acceptable performance in the presence of system uncertainty and to given design 
specifications usually described in both the time and frequency-domains. However, 
despite its practical importance, this problem still remains to a large extent unsolved, 
even in the simpler case where the system under consideration is linear. During the 
last decade a large research effort has led to procedures for designing robust controllers 
capable of achieving desirable properties under various classes of model uncertainties. 
The 7Yoo“framework, combined with /i- analysis ([22], in order to exploit the struc- 
ture of the uncertainty) has been successfully applied to a number of hard practical 
control problems (see for instance [110]). However, in spite of this success, it is clear 
that plain TYoo-control can only address a subset of the common performance re- 
quirements since, being a frequency-domain method, it cannot address time-domain 
specifications. Some approaches that incorporate time-domain constraints into the 
Hoo-formalism have been recently developed ([109], [95], [122]). However, these ap- 
proaches require solving large, non- differentiable optimization problems and typically 
result in a very large controller order, necessitating some type of model reduction 
([ 122 ]). 

A different approach to robust control has been pursued in [131], [74], where ro- 
bustness and disturbance rejection are approached using the /i-optimal control the- 
ory introduced by Vidyasagar ([131]) and developed by Pearson and coworkers ([74]). 
These methods are attractive since they allow for an explicit solution to the robust 
performance problem. However, they cannot accommodate some common classes of 
frequency-domain specifications (such as K 2 or 7^ (X) -bounds). 

Finally, a third approach to controlling time-domain constrained systems exploits 
the concept of positively invariant sets ([10], [123], [121], [130]). Although this ap- 
proach leads to simple design algorithms and has recently been extended to encompass 
some robustness considerations, it cannot handle frequency-domain specifications. 

In the following an approach is presented that satisfies certain time-domain con- 
straints by converting these constraints to problems where set-induced operator 
norms are minimized (or bounded from above). The frequency-domain constraints 
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considered here are robust stability criteria expressed in term of Woo-constraints. 
Note that ^-performance measures can be incorporated in the same way as in ap- 
pendix C. However, this will not be considered further here. Consider the following 
linear, shift invariant, discrete-time system 


£ 


D,oo,op,$F 


x{k + 1 ) — Ax(k) + B\w[k) 4- B^u^k) 
< z<x>{k) = C 2 x{k) + D 23 u{ k) 

, VW = x(k) 


(0.3) 


where (A,B 3 ) is controllable, Z) 23 has full column rank, x(k) G R n * , w(k) G R' lw , 
Zoo(k) G R nzo ° and u(k ) G R ,lu . System uncertainties are assumed to be lumped into 
the system A ( 2 ) with w(z) = A(z)z 00 (z). The controller under consideration is a 
static full state-feedback controller Co = D c realizing the control law u(k) = Coy(k). 
Given a state-feedback matrix Co, the closed-loop system can be expressed as follows: 


^D,oo,c/,.9F • \ 


x c i{k + 1 ) 


>(*) 


A cl x c i(k ) + B\w{k) 
(A + B 3 C 0 )x d (k ) 

C c / ( oO^'c/(^') 

(C 2 + D 23 Co)x cl (k) 


(D.4) 


where A d — /l + B^Cq. Let L, 2 ) denote the closed-loop transfer function from 
w[z) to 200 ( 2 ). In face of equation (D.4) we can state the design objectives of the 
design problem considered here as follows. 


P^oo.t: ?Go-Robust Control Problem with Time-Domain Constraints: 

Given the system So, 00, op , sf and two convex, compact, balanced sets ([62]) containing 
the origin in their interior, W C R n * and U C R nu , find a stabilizing static state- 
feedback gain matrix Co such that: 

||r oo (C 0 ,2)||oo <7 (D.5) 

and, for the nominal system S D ,oo ,d,SF with w(k) = 0 Vfc, 


x cl (k) G W, VC 
u(k) G U, VC 


(D.6) 

(D.7) 


202 


Time-domain constraints such as (D.6) or (I). 7) have important implications in plants 
where the closed-loop system states x c i(k) and the control u(k) are required to remain 
within certain safety limits. Typical examples for such plants are boiler systems 
or power plants. Note that the specific type of time-domain constraints depends 
on the choice of the spaces W and U respectively. Constraint (D.5) on the other 
hand enforces robust stability with respect to the uncertainties &(z) in terms of an 
TYoo-constraint on T^Co, z). To establish the connection between the problem of 
minimizing an induced operator norm and the time-domain constraints (D.6) and 
(D.7) a result concerning constrained control problems is recalled ([121]). 

Definition D.1.1 ([62]) 

The Minkowsky functional p(x c i) of a balanced cojivex set w containing the origin in 
its interior is defined in terms of a real scalar parameter r > 0 by 

p(^c/) = inf |r: € vvj . (D.8) 


A well-known result in functional analysis (see for instance [62]) establishes that 
p(x c i(k)) defines a seminorm in R Ux . Furthermore, when W is compact, this seminorm 
becomes a norm. This result is exploited in the following lemma. 

Lemma D.1.1 ([121]) 

Consider the system: 

x c .i{k -T 1) = A c ix c i(k) (D.9) 

and let ||.||vv denote the operator norm induced in /? n * Xn * by W 

114*11 w= sup ||>l c <x c /(A;)||w' / ). Then, given W and an initial condition 

ll*clWllw=l 

x c i(k = 0) G W, the trajectory x c i(k) 6 VV for all k if and only i/||/f c /||w < 1. 

This lemma shows that the time-domain constraints (D.6) and (D.7) can be expressed 

equivalently in terms of bounds on the induced operator norms ||v4 c /||w and ||(7o||w^ 

respectively where ||C 0 ||ny/= sup ||CoXcz||w- 

ll*cl(*)l|w<1 


||'d c /||w < 1 

|Co||w,<v < 1. 


(D. 10) 
( 0 . 11 ) 
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Moreover, it can be shown ([123], [124]) that minimizing ||y4 c /||w maximizes robustness 
against parametric model uncertainty and minimizes the effects of the disturbance 
w(k ). In the next section it is shown how to utilize lemma D. 1.1 and the controller 
parametrization Cq = WX~ ] to convert problem Phoo,t to a convex suboptimal 
optimization problem. 

D.2 Reformulation of the Design Problem as a Convex Optimization Problem 

Using the controller factorization Co = WX~ l as in section 6 . 2 . 1 , corresponding 
discrete-time ARI (LMI)-citeria for the Hoo“bound have been established for the full 
state-feedback case and are as follows. 

Lemma D.2.1 ([55]) 

Consider the asymptotically stable system Ed,oo,c/,sf- Assume that (A ch B 3 ) is con- 
trollable and (C cl , oc» A cl ) is observable . Then the following statements are equivalent: 

1. i|r 00 (Co^)|| 00 <7 

2. ARI: There exists a symmetric positive definite matrix Y such that 

ARIr),$F{CoyY,'y) < 0 (D.12) 

ARIdMCoMi) := AdYAl-Y + B x Bf 

+AciYClJM(C 0 ,Y,'?)}-'C cioo YAl, (D.13) 

M(C 0 ,Yn) = 7 2 / - C c i t00 Y Cj loo . (D.14) 

3. There exists a symmetric positive definite matrix X such that 

LM Id,sf{Co, X, 7 ) < 0 (D.15) 


LM Id,sf{Co , V, 7 ) 



X(Al 


CJ ,,„ ) 


(6, T 0)- 


X 0 \ 

0 7 2 / / 


+ 


B, 

0 


{D. 16) 
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Lemma D.2.2 ([ 55 ]) 

Consider the same system as in lemma D. 2.1 and let C 0 = W X~ x with K £ /? n “ xn * 
and X = X T > 0 £ R Ux xni , i/icn the matrix mapping LMIu > 5f(C'o,^,7) = 

LM Id,$f{Cq = WX~ x ,X, 7) = LM Id,sf{W, X, 7) with 


LM Io,$ F (W, X, 7) 


/ 21 + \ / + + 53WX- 1 

U'2 + £>23 W*- 1 J A U'2 + £>23 WX" 1 



0) 



T 


(D.17) 


zs jointly convex on W and X . Furthermore , i/if re: exists a static state-feedback 
Co ~ W X~ A such that ||T , oo (C 0 ,^)|| oo <7 ?/ and only if there are W and X ~ X T > 0 
such that LM Id,$f{W, X,~/) < 0. 


Hence, even in the discrete-time domain, the controller factorization Co = WX~ l 
provides a means to represent the Hoo-constraint in terms of the convex matrix 
inequality LMId $f{W, X, 7) < 0. By utilizing the cost function in chapter 4 it is 
then known that the matrix constraint LMI Dy $ F {W,X, 7) < 0 and hence the 'Hoc- 
constraint ||T 1 00 ((7o, Z )\\oo < 7 can be substituted by a convex scalar constraint 

lim Trace { e LMlDSF(w ' x '' y)t f i } = 0. fD. 18) 

tf \— ► OO } ' ' 

The equivalent time-domain constraints (D.10) and (D. 1 1) in terms of the induced 
operator norms on the other hand depend on the chosen spaces W and hi and are not 
in general convex if the controller factorization C 0 = W X~ x is selected. However, 
since all finite-dimensional matrix norms are equivalent ([49]), it follows that there 
exist constants cq and c 2 , depending only on the geometry of the sets W and U, such 
that 


ll-llw < ciIUIf (D. 19) 

11-llnvY < c 2 ||.||f- (D.20) 

Hence, suboptimal time-domain constraints for the inequalities (D.10) and (D.ll) 
can be defined in terms of the Froebenius norm of the matrices A cl and C 0 . To 
this type of cost function the results in appendix C are applicable to define convex 



upper bounds for ||A c /||/r and ||Co||f using the factorization ( 7 0 = W X~ x for which 
the 7Yoo-constraint can be represented by a convex constraint. Note that only the 
differentiable upper bound developed in appendix C will be used here. Utilizing the 
triangular inequality, the submultiplicativity property of the Froebenius norm, the 
controller factorization Co = W and the results in appendix C, it is easily verified 
that 


IMc/||f = \\A + B*WX- l \\ F 

< \\A\\ F + \\B 3 wx~ l \\ F 

< \\A\\ F + ]-Trace{T 2 X- 1 ) + ~Trace(W T Bj B 3 W) 

£ £ 


(D.21) 

(D.2‘2) 

(D.23) 


where r > 0 and ^I — X < 0 are assumed to hold. Joint convexity of ^Trace{r 2 X ~ l ) 
and the constraint — X < 0 in r > 0 and X = X T > 0 have been shown in ap- 
pendix C. Convexity of the term Tract{ W T Bj B^W) follows immediately from lemma 
A. 1.7 in appendix A as Bj B% > 0. With ||A||f being a constant, overall joint convex- 
ity of the right hand side of (D.23) on IV, X = X T > 0 and r follows immediately. 
Hence with the results in appendix C and with the factorization Co = W X~ l we have 
arrived at the following upper bounds for the induced norm inequalities (D.10) and 

(DU) 

— ||A c /||w 


and 

— Il^ollw^ 

c-2 


With these upper bounds, the cost function defined in chapter 4 and the abbreviations 

J p {W,X,t) = l -Trace{T 2 X~' 1 ) + ]-Trace(W T BjB 3 W) (D.29) 

z z 

Jp{B 3 W,X,t) = \-Trace{T 2 X-') + -Trace{W T W) (D.30) 

z z 


< - (D.24) 

< H^Hf + X -Tract{T 2 X~ x ) + \-Trace{W T B 3 W) 

(D.25) 

= -WWX-'Wwju (D.26) 

< \\B 3 WX-'\\ F (D.27) 

< \ Trace(T 2 X- 1 ) + ^Trace(W T W ). (D.28) 

w Lj 
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we are now in the position to reformulate problem Phcx>,t as a convex suboptimal 
optimization problem. 

(Convex Suboptimal T^oo-Robust Control with Time-Domain Constraints: 
Given the system £r;,oo , o P ,sf, find W and X = X T > 0 such that: 


1 .) 

lim Trace { 

if i—^oo 

e LMl D , SF (w,x n )tf^ _ q 

(D.31) 

2 -) 

lim Trace { 

t j<2 — >00 

e~ Xt f 2 } = 0 

(D.32) 

3.) 

lim Trace { 

tf 3— >00 

e [Jp(B 3 W 1 X,r)-J r ]t / 3 | = 0 

(D.33) 

4.) 

lim Trace { 

tj 4 —►00 

e [Jp{W,X,r)-^]t f ^ =Q 

( D.34) 

5.) 

r > 0 . 


(D.35) 


where b u is the maximum control effort allowed. Note that the performance func- 
tional Jp(Bs VP, X, r) does not include the term ||/1||f which is part of the upper 
bound (D.23). This is justified by the fact that ||^4||f does not depend on any of the 
optimization variables and thus is constant. Once such a controller has been found, 
the actual (nominal) bounds on the desired time-domain constraints (D. 6 ) and (D.7) 
follow from the chosen spaces W and U and the corresponding constants C\ and c 2 in 
(D.19) and (D. 20 ). 

D. 3 G radian t Expressions 

The suboptimal reformulation of the original problem P HooJ hi terms of P C ^ T in 
(D.31) - (D.35) is generally a multi-objective problem. Numerically it can be solved 
using the same tools as in appendix C or in chapter 5. That is, it can be solved either 
as a sequence of constrained optimization problems where one selects one of the costs 
in (D.31) -(D. 3 5) as performance costs and treats all the other criteria as constraints. 
Alternatively one can form an overall cost function (see chapter 5) and solve the 
problem as a sequence of unconstrained minimization problems for increasing values 
of tji (i = 1,2, 3,4). The problem is in general differentiable, where r > 0 and X > 0 
have to be enforced as continuity constraints throughout the numerical optimization 
(see discussion in chapter 5). Note that the constraint (D.31) enforces the block- 
structured matrix inequality LM Id,sf(W, A", 7 ) < 0 . Hence, to derive gradients for 
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the cost function associated with the constraint (D.31) the results for this type of 
matrix inequality constraints in chapter 4 have to be utilized. Following these results 
and the framework in appendix A and appendix B, gradients for the cost functions 
associated with the problem are as follows. 


1. Trace { e IjMlD < SF ^ W ' X '' 1 ^ t f i } : 


Let 

Eo sf = e LMlD ' SF ^ w,x '^ tfi = | Ed,sf,u Ed, sf, i2 

\ Ed,sf,i i Ed,sf, 22 

where the partitioning of Ed^sf corresponds to the block-structure of 
LM1 D , SF {W, X, 7 ), then 


(D.36) 


d Trace { e LM1 °^ w ' x 'T t n} 
OW 

d Trace { e^^^ D ’ SF ^’ X, ' r ) t f 1 } 

dX 


d Trace { eT M ^ D - SF ^ W '^ ,1 ) t i *} 

dr 


2 tj\ 


B 3 

Dn 


T 

Ed,sf 



tj i {Ed,sf, n + 



(D.37) 



-X'W 


B 3 
7^23 


T 


Ed.sf 


b 3 

B'23 


WX ~' } 
(D.38) 


0. 


(D.39) 


2. Trace : 


d Trace {e tM*"W-£ ],„ } 

dW 

d Trace {e [MB3W ’ X ' r) ~^} 

dx 

dr 


= t f3 BjB 3 W e [Jp{B3W ' X ' T) ~^ ]tf3 (D.40) 

= -t J3 T 2 X~ 2 e [Jp{B3W ' X ' T) -^ ]tf3 (D.41) 

= t J 3 TTracc{X-')e lJ * B > w ' x ' T) -# t » 


(D.42) 
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3. Tract { C ' J ' [WX 

t„ W (D.43) 

- t/1 t‘ X- 2 e lJ ’-‘ ,v ' x ' r >-%l‘r< (D.44) 
2t /l (' J t)e lJ ' ,W ' X - rh « , ‘'-. (D.43) 

T> J 

The gradients for all the other cost functions associated with the constraints (D.31) 
- (D.35) have been derived in appendix B and appendix C. 

D.4 Example 

The approach is illustrated on a discretized 4 (/l -order system representing the lateral 
dynamics of a B-767 aircraft. The (continuous-time) model is the same as in sec- 
tion 6.2.1 and appendix C. For this plant the state-space matrices are given as follows: 

0.9966 0.0227 -0.0084 -0.1120 

-0.0037 0.7952 0.1633 0.0005 

-0.0063 -0.6008 0.7661 0.0003 

-0.0007 -0.0645 0.1779 1.0000 

0.1885 
-0.0003 
-0.0007 
0.2000 

< 7 2 =( 0.0100 0 0.0100 o), Z > 23 = 0.0100. 

The open loop system is stable, the open-loop Tioo -norm ||r oo (C' 0 , z)||oo is 7.4826, 
the minimally achievable norm ||7 1 oo (C7 0 , z)!^ is approximately 0.007 and the Froebe- 
nius norm of the open-loop system-matrix A is ||j4||f = 1.9102. For this plant the 
following optimization has been solved for various Tfoo-bounds 7 spec . 


-0.0029 

-0.0762 

-0.6529 

-0.0683 




a 1 race {e l ' c 2 ‘ >* j 

dw 

o 1 race {e c 2 J /4 j 

dX 

■Arp { [J P (W,X,T)-^]t H r 

O 1 race {e ' c 2 J /4 } 

dr 
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mm J p (B 3 W, X,t) + \\A\\ F (D.46) 

subject to 

lim Trace { e LMI D,sF^Xn)t t n _ 0 (D.47) 

tf i-^oo 

lim Trace \e~ Xtf2 } — 0 (D.48) 

r> 0. (D.49) 

Thus, for this example, we actually minimize the upper bound Jp{B$W, X , r) + ||A||/r 
rather than bounding it from above. Hence the mixed performance/robustness prob- 
lem solved here uses the upper bound Jp(B^W, X, t) + ||A||f as the performance 
cost. Robust stability is incorporated by an TYoo-bound in terms of the constraints 
(D.47) and (D.48). Thi s implies an optimization on possible (nominal) time-domain 
constraints on x x i(k). Possible time-domain constraints on u(k) are not explicitly 
incorporated in this example. Figure D.l displays the results for the optimization 
problem (D.46) - (D.49) with the given plant. The upper curve ( c *’) plots the up- 
per bound cost Jp{BzW, X, r) + ||A||f versus the specified 7foo“bound 7 spec . The 
center curve (’o’) and the lower curve (’+’) reflect the resulting Froebenius norms 
of the closed-loop matrix A c i (||/I c /||f) and the controller gain W X~~ l (\\WX~ 1 ||f) 
respectively. 

All curves display the usual performance/robustness tradeoff characteristics. In- 
teresting is the fact that ||A c /||/7 decreases monotonically up to 7 spec = 0 . 1 . For 
7 spec. > o.l ||A c /|Jf increases and converges to the open-loop norm \\A\\p. This fact is 
due to the stability of the open-loop system. Note, that for 7 spec > 7.4826, W = 0 
will satisfy the required 'H 00 -bound and “stabilize” the system and ||A c /||f = ||^ 4 ||f = 
1.9102 in this case. The achieved controller gain ||VFA r_1 ||/r on the other hand shows 
the typical performance/stability robustness tradeoff and exhibits the behavior al- 
ready encountered in the equivalent continuous-time example (see section 6 . 2.1 and 
appendix C). Depending on the type of time-domain constraints on x c i(k) y the cho- 
sen spaces W and hi and hence the constants c\ and 02 one would now select one of 
the design points to derive the actually achieved bounds on the desired time-domain 
constraints. 







Appendix E 

MULTI-PLANT ^-DESIGN SOFTWARE 


The underlying approach for the TYoo-design software is equivalent to that presented 
in chapter 5 except for the notational convention. That is, n v open-loop plants of 
the following form are considered here. 



x ( t ) 

= A'x^t) 

+ 

B\u x (t) 

+ 

s >^(0 

S' : < 

oo,op 

y '{ t ) 

= C\x'{t) 

+ 

D' u u'{t) 

+ 

d 5 ' 2 ? 4(0 


. 4(0 

= C&(t) 

+ 

D! n u l (t) 

+ 

^ 22^(0 


(E.I) 


for i = 1,2,..., n p . This notational convention is most widely used in literature (see 
e.g. [115]). For a given plant condition, model uncertainties are assumed to be 
lumped into a stable, norm-bounded A 2 (.s)-block, 


IIA'MII 



with the usual feedback connection 


(E.2) 


(E.3) 

The state vectors x l (f), the control inputs u z (t) and the disturbance input/criterion 
signals and z^t) are assumed to have the same dimensions as in chapter 5. 

That is, x z (t) £ R ! 1 *' , 11^(2) € R 71 ™'™ , z oo(t) ^ R^' 00 , u*(i) £ R Hu ' and y l £ R Uyl for 
i — 1,2, ...,n p . All the involved matrices are assumed to have compatible dimensions. 
The controller (7(,$) has the same form as in (3.4) with a corresponding parametric 
representation 


Co 


D e C c \ 

B c A c J 


(E.4) 


With these definitions and the notation in this appendix, the system assumptions 
corresponding to the "Hoo-design problem in chapter 3 are as follows. 
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Assumptions: 

Al: {A\B\) are stabilizable pairs for all i = 1,2 , ...,n p , 
A2: (A\C\) are detectable pairs for all i — 1,2, ...,n p , 


A3: dim(u') — n u , = n u and dim{y x ) = n y > = n y for all i = 1,2, ...,n p , 

A4: D] x = D\ x = ... = D% = D u . 

These assumptions have been discussed in chapter 3. Given a controller C Q with the 
state-space realization (3.4), the corresponding closed-loop plants are given by 


SwK-) : 


*’■(<) = AkooAt) + B^wUt) 

4(0 = Cell'd) + D'.wUt) 


(E.5) 


for * = 1,2, ..., n p , where (with the notation in this appendix) the closed-loop matrices 
are as follows. 


where 


Act, oo 

= A { 

+ 

B\C 0 C\ 

B cl, oc 

= B\ 

+ 

b\c 0 d\ 2 

ft 

'"'cl, oo 

= Q 

+ 

D' n C 0 C\ 

n* 

U c\, oo 

'Q 

11 

+ 

d\ x c 0 d \ 2 


(E.6) 


A i = 


A’ 0 

0 0 


, B\ 


B\ 0 

0 / 


B\ = 


B\ 

0 


, / 

C\ 0 
0 I 

\ 

( \ 


Q - ( 

II 

o), 


[y — 
U 12 ~ 

( ? ) 

. ^1 = 1 

l D 'n 0) 

ry — ni 

y u 2'l ~ u 2'2 


With the n v closed-loop matrices A' cloo , B x cl oo , C l d oo and D‘ / oo the n P ^-constraints 
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||T^(Co, s)||oo < 7* are then equivalent to the system of matrix inequalities (3.30): 


1) 

ARI' C 'Of(Co,X\Y) 

< 

0 

2.) 

- (7*) 2 / 

< 

0 

3-) 

-X* 

< 

0 

4-) 

X 1 

= 

X iT 


where the corresponding matrix expressions in (E.7) have been defined in chapter 3. 
An important observation on a lower bound for all X x has been made in theorem 
2.2.1 of chapter 2, namely 

X { > L\ (E.8) 

where L x 0 is the observability grammian that satisfies 


A‘J^Ll+LlA[ 


i n iT (' l 

' ^ y c/,<xA'c/,oo 


0 , 


(E.9) 


assuming A x cloo is stable. Hence, solutions X x satisfying (E.7) can be rewritten as 
X 1 — L l 0 -fi X x + X zl — diag{X l ) for a set of n p upper triangular matrices X 1 . This 
knowledge is explicitly incorporated into the design software. Rather than having a 
set of n p optimization variables X\ we optimize over n v upper triangular matrices X z 
(see (5.13)) from which X 1 is formed by X x = L x 0 + X x + X xT — diag(X x ). The condition 
— X 1 < 0 can then be replaced by the condition that — (X* + X xT — diag(X x )) < 0 
as L l 0 is positive semidefinite. Symmetry of X x is explicitly taken into account in 
this formulation. The enforcement of the required stability constraints on <00 is 
described later. 

To avoid local minima in this general purpose design package an additional con- 
straint of 

A l aux + B l aux X % to be asymptotically stable (E.IO) 

with 

BL - (E.12) 


is enforced as well (see discussion in chapter 5). The set Q contains the specified 
7-foo-bounds y and is defined in chapter 5 and for further reference the following set 
is introduced. 


X — { X x : X 1 upper triangular , i — 1,2, ..,n p }. 


(E. 13) 
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E.l Design Cost Function 

With the above sets and abbreviations and the cost function defined in the body 
of this report the multi-plant 7-foo-design problem stated in chapter 5 can now be 
restated as follows. 

“Find an internally stabilizing controller Q and a set X* of n p matrices X 1 * that 
solve the following minimization problem. 


J{c;,x*) = 




lim min £ J' des (C 0 , X\t' n ,t)- 2 , t) 3 , t) 4 ) 

t* r ,~*oo Cn.X : i 


V * - C 0 .^ i=1 

(fc=l, 2,3,4, t=l,..,n p ) 


+fU.(x\r t3 ) + /UAX\t i M )} 


(E. 14) 
(E. 15) 


/U,(c 0 ,x\f„) = 

Trace { e MI'(C 0 ,X')t )l} 

(E. 16 ) 

/b„(Co,<y = 

Trace {e-h^-^coo^h.J^} 

(E.l 7) 

= 

Trace {e _[ *' + *' T_rf,a 3 ( * ,)] ‘/ 3 } 

(E. 18) 


n xt +n c 



E ( 4 a. )*(*%)] 

k= 1 

(E. 1 9) 


r [ e ( A ”)i‘/« - ip if (A rr )i > o 

1 0 if (A re )[. < 0 

(E.20) 


where 


ARI'(C 0 , P) = + CZ.DitoXRfr'WBi^ + CiT„D' dt „y 

+ A'Jv 0 X‘ + X'A dv + 

A 1 = L* 0 [ X 1 + — diag^X*)), 

X 1 is upper triangular, 


ls stable, 


Ad,ooL l 0 + L' 0 A' d ^ + — 0, 

[A'aux + B 'au X X' ][(«re)3fc + = [{Ke)' k + j( Aim )fc] [(«re)]fc + j{u,m)k\- 
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If a solution can be found for Cq and X * that yield a finite value of J(C$, A'*), then it 
is guaranteed that all the specified Woo - constraints are satisfied. The overall number 
n var of possible optimization variables in the minimization problem is 

Up j 

n var = n con + ^2 -(n x , + n c )(n xt + n c + 1) (E.21) 

i=i ^ 

where n cou is the number of selected optimization variables in (7 0 . 

In our approach the variables Vj k ( k = 1 , 2,3,4, i = 1 , ..,rc p ) act as scaling vari- 
ables in the overall cost function £?= 1 J l des (C 0 , X\ t l }2 , t l f3 , t l f4 ). Starting with small 

values of t l j k we proceed to optimize the objective function Ya= \ */*(Co, X\ t x j^ t l f 2 , 
^ 3 ^/ 4 ) un ^il a reasonable convergence has been reached for these values of Vj k , The 
values t l j k are subsequently increased and the optimization is repeated. This process 
is continued until all the constraints have been successfully satisfied. In this case, a 
controller that satisfies all the 7"Go“bounds has been found. The convergence often 
fails when the objective function cannot be improved further after the specified num- 
ber of iterations has been exhausted. In this case the chosen TYoo - bounds may be 
either too small, or the desired controller structure is too restrictive. 

E.2 Gradient Expressions 

The gradient expressions for all relevant cost functions can be derived using the 
formalism in the appendices A and B. With the new characterization X 1 = L l 0 + 
[X x + X tT — diag(X 1 )] the according gradient expressions are quite complex but are 
included at this point for the sake of completeness for the case CosEs el ~ 1 (Trace- 
type cost function). Gradients for the cases CosEsel = 2 and CosEsel = 3 are easily 
found from the results for CosEsel = l (see Hi_des_grad.m). Using the following 
definitions 

E\ = e ARI'(C 0i X')t' fl , 

E\ = e - [( 7 l ) 2l - D Z^ D ci t <Jt) 2 ^ 

El = 

4 = + BlUHT' 

4 = 


(E. 22 ) 

(E.23) 

(E.24) 

(E.25) 

(E.26) 
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4 

= «^.lo^(« , r’os» + /icgu. 

(E.27) 

4 


(E.28) 

4 

= (l; + i‘.¥)£|, 

(E.29) 

4 

= [<4 + n\ lift')-' if]£|, 

(E.30) 

4 

= X 'K\ + [cf„ + L\(R')-' D'lJb'n, 

(E.31) 

T l 

Zvg 


(E.32) 

A 1 

= 4 + Lg T , 

(E.33) 

4o 

’ ^c/,oo4o + 4o^c?oo + ^9 = 0, 

(E.34) 

4, 

•• ^oo4i + 4i4,oo + 4 / T oo4/,oo = 0, 

(E.35) 

4 2 

= 4* 4o(4i4’ + 4^), 

(E.36) 

4.3 

= 4!4,.oo44l 

(E.37) 

44 

_ (^2^ [( U re)fc(v re )fc + («im )/t(^ m )fc] 



+ (^hm l{UrrMvLn ~ {u - Uv ' M 

(E.38) 


[L\ + Lix'][(u re y k+J (u tm y k } = [(Are)! + i(A im )i][(tl„)i + i(« tm )‘] 
[L\ + LixYlMi +j(v im y k ] = [(A re )i. - j(\„ n y k ][(v re y k + j(v im y k ) 

[(^re)* — i( u im)fe] T [(«re)l. + j(w»n)fc] = 1 

[(^re)fc - j(»im)i] T [(Vre)i + >(»,•«,)’*] = 1 

)k = ( u L)U«re)fc - {vj e y k {u im y k 

(?2 )!• = ( v Im)k( u im)k + )!• ( u r-e )fc 


45 = 

44 5 + 4; 2 (fi*)- 1 [4S 0O Q,oc4 5 

+ BkJLZX* + X'(L< 5 )] 

(E.39) 

4e = 

B\ + 


(E.40) 

4 7 = 

DURT^^LZCZJI + D koc 


(E.41) 

[ 1 — 
^18 ~ 

4s 4 + 44s 


(E.42) 

/ * — 
^19 — 

4i 


(E.43) 

4o : 

4d, oo^20 + ^2 o3‘^ to + /-I. = 0, 


(E.44) 

4, = 



(E.45) 
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^22 — L\ s L * 16 + L\ 7 4- L 21 
the gradient expressions can be written as follows, 


(E.46) 


i>fU,(Co,X\V„) 

= <>i(d + £f) 



ax • 



9/U(Co,X\IW) 

= 2 + L l 7 + L\ 2 ) t 



sc,, 



dC 0 

= 2 tf 2 Li 3 



8fU.(x‘,e„) 

SX‘ 

= —tj 3 E 3 




\ 2<V-4 [e (Ar * ) * t J f4 - l]e (Ar,) * t >4 lL 

if 

o 

Al 

t- 

dX‘ 

= 1 

if 

o 

V 

: 


{ 2t’ /4 [e (Are) *=‘j r 4 - l]e (Ar ')*'/«z4 2 

if 

n> 

IV 

o 

dc o 

= i 

if 

ru 

A 

o 


(E.47) 

(E.48) 

(E.49) 

(E.50) 

(E.51) 

(E.52) 


All the other partial derivatives are zero. Gradients of the overall cost function are 
given by the summation over all the plant conditions of the individual gradients 
at each plant condition using equations (E.47)-(E.52). Note that the cost function 
/■MesC^N^) *s differentiable only if the according eigenvalues are simple. This for- 
mulation has worked well in a practical implementation. There may, however, be 
situations where the algorithm fails to converge due to the presence of parameter 
combination such that the cost function is not differentiable. To cir- 

cumvent this problem, an additional set of parameters needs to be introduced (see 
discussion in chapter 5). Such additional variables, however, would increase the com- 
putational burden considerably and hence this route is not chosen in this design 
package. 


E.3 Program Structure 

The above formulation requires that all are stable matrices. Hence before start- 
ing the optimization on the above overall cost function a controller has to be found 
that internally stabilizes all n p plant conditions simultaneously. For this reason the 
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overall algorithm is divided into two phases as follows. 

Phase 1 : 

Find a controller <7(.s) that stabilizes all plant conditions simultaneously such that 
HD'h.J < 7 * for all plant conditions. This phase utilizes a cost function similar to 
that in (E.19) and (E. 20 ) defined on the closed-loop matrices A x cloo (see Hijdes.m 
and HLdes Junc.m). 

Phase 2: 

Optimize on Y?i=\ ^/p^/ 2 ^/ 3 ^/ 4 ) f° r increasing values t l j 2 , t*j 3 and t l j 4 

until all Woo-constraints are satisfied. 

E.4 Program Description 

Software Requirements and Global Variables 

The included MATLAB-files are written for the MATLAB-version 4.1 and require 
the following additional toolboxes: 

1. Control Systems Toolbox 

2. Robust Control Toolbox 

3. Optimization Toolbox 

MATLAB 4.1 offers the capability of limiting the scope of the global variables. 
Namely, if a variable is not defined as a global variable inside a function, then it 
is considered a local variable there. 

In MATLAB 3.xx a global variable is global everywhere. Hence, if the user is in- 
terested in running HLdes. m on MATLAB 3.xx, the removal of the global statements 
in all functions is a possibility. The variables that are required globally have then to 
be defined as global variables before calling Hi_des.ni. These global variables have 
the following names: 

• GlobaLvar n-p n.u njy n.c Njvar NjoarX N.varCo N.varX.ind 

• System. 1 System.2 System .3 ... 



219 


• Dimensions Dimensions. I Dime nsio ns. 2 Dimensions.3 ... 

• Co-fix Covar.fix C.optim Co.varJndexset Xvar.fix X.optim 

• D.optim Stab.bound Stab-only Cost^sel 

These variables will be erased from the global workspace and should not be used in 
the external program calling HLdes.m. 

EJ}.2 M ATLAS Functions 

The software includes the following MATLAB-files: 

• HLdesJnpu.m 

• HLdes.m 

• HLdes -func.m, Hi_des_grad.m 

• Hi_des_upda.m, HLdes_tfup.m 

• Hi_des_opti.m, Hi_des_qupr.m, Hinorm_comp.m 

A copy of this software can be obtained directly from the authors. For this reason a 
listing of these files is not included in this work. All of these programs are M ATLAB- 
functions, that is, except for the global variables, they do not share common variables. 
All functions have an extensive header containing information on the purpose of the 
input and output variables, and the required global variables. This information can 
be retrieved by typing “help HLdes.m”, “help HLdes Jnpu.m”, ... and so on. In the 
following we will describe each file separately. 

1. HLdes Jnpu.m 

This function requires the user to enter the plant data for each plant condition. 
Except for the data storage, this function does not have any input or output 
arguments. Before this routine is called, the user should have the following data 
ready for input: 
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• A filename under which the plant data will be stored. The data will be 
stored in the chosen filename plus the extension -hi. mat. For example, if 
the chosen filename is “Test”, then the data will be stored in a MATLAB 
data file named “Test Jii. mat” . 

• n p is the number of plant conditions. 

• n y and n u are the dimensions of the measurement vector and control vector 
respectively. Note that these two dimensions must be the same for all plant 
conditions. 

• n x », n w i^ and n z % are respectively the dimension of the state-space plant 
model, the dimension of the disturbance vector and the dimension of 
the criterion vector z ^ for the i th plant condition. 

• The system matrices for each plant condition are saved in the following 
form: 


SystemS — 


\ 


A 1 

B\ 

b i 

\ 

C\ 

d ii 



ci 

^21 

D'22 

) 


Note that the matrices D' u are required to be identical for all plant con- 
ditions. It is suggested that the user stores these matrices in a xxx.mat 
file which can be retrieved during an input session. The variable names 
for these matrices should however not conflict with the global variables as 
defined above. 


2. Hi_des.m 

This function contains the main program. This is the function to be called for 
the actual design of a controller. Its input and output arguments as well its 
internal organization are discussed below. 

3. Hi_des_func.m 

This function computes the function value ]Ci=i J^ e5 (Co, * rV/1^/2^/3^/4) & s 
defined above. The variable Costsel (specified in HLdes.m) can be used to 
redefine the cost /{^(Co, X\ t^) in terms of the eigenvalues of the i th ARI 
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similar to (E.19) and (E.20). For Costsel = 1 the trace-type cost function 
is applied, for Costsel = 2 or Costsel = 3 the cost function is defined in 
terms of the eigenvalues of the i th ARI (Note that Costsel is a global variable 
and it is defined in HLdes.m). The specific cost functions /{^ ea (Co, X x , t x j x ) 
corresponding to Costsel are as follows. 

• Costsel =1: 


= Trace }. 


(E.53) 


• Costsel — 2: 


+n c 






E (/UMC 0 ,X\f„) (E.54) 

= 1 

[ e ( Ar ')i t / 1 _ i ] 2 if (\ re y k > o 


*=1 


if (A re )l<0. 


(E.55) 


Costsel =3: 


fUACa.X 1 ,!),) 


n x , + ™C 

E (fUMc<,,x\t' n ) 

k-l 

{ <‘/l[( A ")i] 2 *7 ( X re)i>0 
\ 0 if (A re )‘ fc < 0. 


(E.56) 


(E.57) 


For Costsel = 2 and Costsel = 3 in the above formulae (A re ) l fc represents the 
real part of the k th eigenvalue of the i th ARI: ARP(Co, X % ). The gradients are 
computed according to the variable Costsel. 


4. Hi_des_grad.m 

This function computes the gradient of the function J^ es {Co, X', t',^ t\ 2 , 

t'f^t'jt) as defined above. 

5. Hi_des_upda.m 

An auxiliary function that updates important variables needed to compute new 
values for t'j k . 
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6. HLdes_tfup.m 

An auxiliary function that computes the new values for t l j k . The specific values 
used for the ^-updates have been derived empirically and worked for a range 
of problems. However, there may be problems where this update scheme is 
not sufficient. Users who are familiar with the MATLAB script are encouraged 
to alter this routine for improved convergence. However, when the function 
is altered the following numerical issues should be examined carefully. First, 
continuity and smoothness are relative properties when numerical methods are 
applied to an optimization problem. In general the scaling variables Vj k should 
not be increased to large values (in comparison to the other t l j k values) even if 
the corresponding inequality constraint is satisfied. Such a V Jk update scheme 
would introduce unnecessary numerical problems due to “almost non-smooth ’ 1 
components in the overall cost function. On the other hand, in some cases the 
values for t x j k may be “too small” resulting in convergence problems due to large 
differences (on the order of magnitude) between the gradients with respect to 
Co and those for X 1 . 

7. Hi_des_opti.m 

This file contains the optimizer which is a modified version of the original con- 
strained optimization program constr.m (see MATLAB optimization toolbox). 
The input parameters can be chosen such that information about the progress 
of the optimization is printed after each line search. In the follwowing a typical 


sequence 

for one of the 

* optimizations i 

s displayed. 


f-COUNT 

FUNCTION 

MAXfg} 

STEP 

Procedures 

1 

1101.55 

0 

1 


31 

1101.55 

0 

1 , 86e-09 


55 

1101.25 

0 

1.19e-07 


385 

424.405 

0 

0.125 

mod Hess(2) 


Intermediate Optimization Terminated Successfully 


In this display “f-COUNT” shows the number of function evaluations used in 
this particular optimization. The factor “FUNCTION” is the (unsealed) func- 
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tion value of the overall cost function. This value give hints to how fast the 
algorithm is converging. If (for Costsd = 1) all relevant scaling factors t l j k 
are larger than one and the overall cost function is smaller than one, then the 
design goal has been reached. However, the TYoo^bounds may also be satisfied 
even when the cost is larger than one. The value “MAX{g}” shows whether or 
not additional constraints are violated or not and should be zero at all times. 
The only constraints incorporated in this software are possible bounds on the 
controller entries. Hence, as long as MAX{g} = 0 all specified controller con- 
straints are satisfied. The step-size parameter “STEP” is a good indicator as 
to whether the optimization has converged after the optimization is completed. 
Extremely small step size parameters indicate that the optimization does not 
progress very well. The column under “Procedures” displays the mode of the 
Hessian update. 

The individual optimizations started with HLdesjopti.m can terminate with the 
following diagnostic messages: 

• “Intermediate Optimization Terminated Successfully”: This run has con- 
verged, the (norm of the) vector for the search direction and the function 
decrease are sufficiently small. 

• “Maximum number of iterations exceeded”: Hi_des_opti.m terminates be- 
cause the number of function evaluations has exceeded the limits specified 
in the variables NrSmproveC and NrAmproveX. Clearly in this case 
convergence has not yet been achieved. 

• “Insufficient cost function decrease”: Hijdes-opti.m terminates if the func- 
tion decrease was smaller than 10~ 6 over 6 consecutive line searches with 
STEP = 1. (Most likely the problem requires an update of the t'j k or it 
needs a rescaling of the optimization variables). 

• “Overall cost is smaller than 1: All Hi-bounds satisfied”: If Costsd ~ 1 
has been selected in HLdes.m, then a function value smaller than one with 
all t l j k > 1 guarantees that all the specified 7-Co-bounds are satisfied and 
a further optimization is not required. 

• “Warning: No feasible solution found”: No solution has been found that 
satisfies the specified upper and lower limits Py and Py. 
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Note that these messages relate to the success of individual optimizations and 
not to the achievement of the overall Hoo-design procedure. Other than these 
messages the subroutine Hi_des_qupr.m may also produce warning messages if 
the corresponding quadratic programming problem is ill-conditioned or encoun- 
ters problems. In general the behavior of HLdes_opti.m can be manipulated with 
the variable “Options” defined in HLdes.m. The Options-vector in Hijdes.m 
has the same meaning as the OPTIONS-vector defined in MATLAB (for more 
information on this variable, type “help foptions” in MATLAB). 

8. HLdes_qupr.m 

Quadratic programming subroutine for the computation of the search direction 
after a line search has been completed. 

9. Hinorm_comp.m 

An auxiliary function to compute the 7^^-norm of a linear time-invariant sys- 
tem. 

In general extensive information is also included within the function files themselves, 
and they are rather self-explanatory. Furthermore, all files contain auxiliary warnings 
and messages detailing the progress and flow of the overall Hoc-design procedure. 

E.J f .3 The Function Hijdes.m 

As mentioned above, Hijdes.m is the main function containing the structural setup 
of the algorithm as described earlier. This routine can roughly be separated into 6 
sections: 

1. Input Variable Check 

In this part all the input variables are checked for compatibility of the data. 
The only thing the user has to take care of is to make sure that the system 
assumptions 1 and 2 as defined in the previous section are satisfied. 

2. Generation of Initial Guesses for the X* 



Depending on whether the user hands over an initial guess for these matrices 
or not, and whether the initial controller guess Co, n is stabilizing or not, initial 
guess for the matrices X x will be generated (see below). 

3. Find a Stabilizing Controller C 0 

If the initial controller guess is not stabilizing for all the plant conditions, an 
iteration is started to try to find such a stabilizing controller. If no stabilizing 
controller can be found after a number of iterations (please refer to the variables 
Nr-iterstab and Funcstabilize in HLdes.m), then the program will terminate 
at this point. 

4. Improve the Initial Parameters X 1 and Co in 

If no X{ n has been defined by the user, or if some of the eigenvalues of the 
ARP s or the matrices R l are very large, then a certain number of “improvement 
loops” is invoked. In these loops a certain number of optimizations (please re- 
fer to the variables NrJterJmpC , Nr-improveC, N r -iter Amp X and NrAmproveX 
in HLdes.m) are performed individually on Co in and the matrices X x respec- 
tively. Failure of convergence can be observed when these values are chosen too 
small in relation to the number of optimization variables, if one or more of the 
Woo-bounds Y are chosen too small or if the chosen controller structure is too 
restrictive. 

5. Main-Iteration Loop 

In this part of the program we optimize on Co and the matrices X\ After 
each iteration the user will get an update displaying the relevant time the 
maximum eigenvalue of all ARI’s (over all plant conditions) and the achieved 
Hoo-norms for each plant condition. 

6. Re- in corporation of a Possible Du / 0 

In this section of the algorithm we re-incorporate the possible case where Y 
0 (as described before) when the final controller is well-posed, i.e., if Z — 
(I — DuD*)~ x exists. 
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The function HLdes.m has to be called with 7 input variables and 3 output variables 
as 

[Co out , Gamma ach , X out ] = H\Aes(Filejname, Gamma , Co in , X in , Pmt var ). 

In the following subsection we will discuss the form and meaning of these variables. 

EJ h 4 Input/Output Arguments of HLdes.m 

1. File_name (string) 

This variable identifies the file where the data was stored during an input session 
with the function HLdes_inpu.ni. The extension Jii.mat will be automatically 
appended to this filename and must not be included in this input argument. 
For example, FiltJiame ~ test 1 would result in a data file named 'test Jii.mat' 
to be loaded. 

2. Gamma, Gamma^ (vectors) 

Gamma (input) contains the desired 7^ (X) -bounds for the n p plant conditions 
and hence has the dimension n p x 1 (or 1 x n p ). 

Gammaach (output) contains the values of the achieved 7"Lo~norms for the 
n v plant conditions after HLdes.m has terminated. Gamma ac / t has the same 
dimensions as Gamma. 

3. Coj n , Co ou t (matrices) 

Co in (input) is the initial controller guess in the format 



compatible with Co as defined in the previous section and hence has the di- 
mensions ( n u + n c ) x (n y + ?* c ). The controller dimension n c is determined 
automatically based on the variables n u and n y . In this way the user can 
choose different controllers with different n c for the same plant data without 
having to repeat the input routine HLdesinpu.m. 

Co out (output) contains the final controller after the execution of HLdes.m has 
been completed. 
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4. P L , P U (matrices) 

Both of these matrices must be of the same dimensions as the chosen controller 
Coi n . These matrices determine lower and upper bounds on the individual 
entries of the desired controller, i.e. Pi < Co out < Py. The bounds Pi and 
Py can also be used to fix the structure of the controller. For example, let us 
assume that n u = n y = 1 and the chosen input parameters Go m , Pi and Py 
are as follows: 

( 0 - 10 9 0 \ 0 1 2 \ 0 10 ° 100 ^ 

Pl = 0 0 1 , Co m = 0 0 1 ,P[/= 0 0 1 

v -10 9 -10 9 -10 9 y 1 2 3 J 10 9 10 9 10 9 ) 

Then the desired controller structure is a strictly proper controller in the con- 
trollable canonical form with 



C c — ( e n ci 2 

D c = 0 


and the additional constraint 0 < c r2 < 100. The initial controller guess is 
expected to satisfy the desired bound Pi < Co{ n < Py, When the structure 
of the controller is unconstrained; that is, when we adopt a general proper 
controller with no bounds on its entries, then the program will assume the 
default bounds of — 10 9 < C Q ij < 10 9 . In this case HLdes.m can be called with 
the following arguments: 

i) No lower and upper bounds are specified (unconstrained): 

[' Co out , Gammdaci, X out ]= HLdes (Filename, Gamma, Go, n , [],[], A A m , Prnt var ). 

ii) Only the upper bounds are specified: 

[Co ouh Gamma acfl , X out ]= Hi_des(Fz/e_ymme, Gamma , Go m , [ ], Py , X tn> Pmt var ) 

iii) Only the lower bounds are specified: 
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[Go out , Gammdach, X out ]= Hi_des (File-name, Gamma, Co tn , P L , [ ], X tn , Prnt var ) 
5. Xj n , X out (vectors) 

As defined in section 3, we optimize over a set of n p upper triangular matrices 
X 1 . Each of these matrices is of the form 


*i,i 


K 3 . 

yi 

' 1) 

yi 

^\,(n xX +n c ) 

0 



yi 

^2,(n xl +n c -\) 

yi 

^2i(n x « +«c) 

0 

0 

*1,3 ■ 

yi 

yi 

^ 3,(71^ +n c ) 

0 

0 

0 

X 1 

(n x \ +n c -l ),(n x1 +n c -l) 

Y i 

( n x* +«c-l),(n J .i+7i c 

0 

0 

0 

. 0 

X 1 

(n jl +n c ),(n z ,+n c ) 


The variables X{ n and X out are saved in a vector array as follows 


XU 

x l h2 

XU 

xU 

Xh 

x'U 

xi 2 

x'U 

xz 

xU 

xU 

xU 


l l.( n *2+ n c) " 

r 2 y‘2 


It is important that Hi_des.m be started with an initial guess .Y, n that satisfies 
X’ > 0 (initial guesses with eigenvalues A(X') < -0.2 are rejected and result 
in an error message!). Typically when the initial guess of X in is not available, 
then HLdes.m may be invoked with the following input arguments 

[Go 0Ut , Gamma ack, X out ]= Hijdes (Filename, Gamma, Co in , P L , P v , [ ], Prnt var ). 

Note that one could also restart HLdes.m with X ou t obtained from an earlier 
run as initial guess for AT,- n . In this case, the above required conditions will be 
automatically satisfied. 

6. Prntvar (non-negative scalar) This input variable controls the amount of screen 
output during the optimization. 
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0 < Pmt var < 5: 

5 < Prnt var < 10: 


10 < Prnt var : 


Only the most important messages are printed. 

Only the most important diagnostic messages and a brief 
summary of the design results after each main-loop 
iteration are printed. 

In addition to the above output Hi_des_opti.m will 
print the function value, the step size and the number 
of function evaluations after each line search. 


E.5 Examples 

E.5.1 Example 1: One- Plant Case 

This example is taken from [88] (see also example 1 in chapter 5). It is a 3 rd -order 
single input /single output plant with one measurement and one control input. The 
example satisfies the system assumptions in [24]. For more details on this plant please 
refer to [88]. In the following we will first demonstrate how to enter the data using 
the input routine HLdesJnpu.m. Then we show excerpts from the diary file created 
during the HLdes.m execution with this plant data. 

E.5. 2 Input of the Plant Data: Hi-des-inpu.m 

Before the HLdesJnpu.m file is called, a MATLAB data file Rid. mat must be cre- 
ated in which the system matrix has been stored under the variable name S\. This 
simplifies the input of the plant data in the routine HLdesJnpu.m considerably. The 
actual call of HLdesJnpu.m produces the following diary file. 

>> Hi_des_inpu 

Are you a new user or need preliminary information? -- y/n n 

Input the file name (char) under which the plant parameters will be 
stored . 

Please enter the input file name : Examplel 

NOTE: If the file Examplel.hi .mat already exists, it will be overriden ! 
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Input the number Np (integer>=l) of different plant conditions :1 

********************************* ^j^*************************** ********* 

Input the number Ny of measurement outputs : 1 

************************************************************************ 

Input the number Nu of control inputs : 1 

************************************************************************ 
PLANT CONDITION 1 : 


Enter the dimension vector [ Nx , Nwi , Nzi ] : [311] 

******************** * ************ ******* ******************************** 

Input the corresponding system matrices for 
PLANT CONDITION 1 with the following format: 

[A , B_1 , B_2 ; 

C_1 , D_1 1 , D.12 ; 

C_2 , D.21 , D_22 ] 

— Pressing the <RETURN> key will put you into the keyboard 
mode to load data. When done, enter the command 
“return" to exit the keyboard mode and continue the program. 

Enter the system matrix (e . g . , [a,b ; c , d] ) : <RETURN> 

K>> load Rid 
K>> return 


Enter the system matrix (e.g. , [a,b;c,d] ) : SI 

************************************************************************ 

Please wait.... Saving the data in Examplel_hi .mat 
Done 


While waiting for the the input of the system matrix, the <RETURN> key is pressed. 
This places MATLAB into the keyboard mode. The file Rid.ynat containing the 
system matrix under the variable name SI is then loaded. We exit the keyboard 
mode to the normal mode by entering “return”. We give the system matrix Si as the 
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input data. This completes the input of the plant data. The file “Example 1 -hi. mat” 
is now the basis for the subsequent call to HLdes.m. 


problem, we 
of the initial 


'/, Examplel.m file 

7 . 

clear 

clear global 

File. name = ’Example!.’ 

eval([’load ’ File. name ’.hi’]) 

Global. var 

System. 1 

Dimensions. 1 

n.p 

n.u 

n-y 

pause 


Gamma 

= 2.3; 





Co. in 

= [o 

1 2 

3; 




1 

0 1 

0; 




1 

0 0 

1; 




1 

1 2 

3]; 



P.L 

= le9* [ 

0 

- 1.0000 

- 1.0000 

-1.0000; 


- 

1.0000 

- 1.0000 

1 

o 

o 

o 

o 

-1.0000; 


- 

1.0000 

-1.0000 

-1.0000 

o 

o 

o 

0 

1 


- 

1.0000 

-1.0000 

-1.0000 

-1.0000] ; 

P.U 

= le9*[ 

0 

1.0000 

1.0000 

1.0000; 



1 . 0000 

1.0000 

1.0000 

1.0000; 



1.0000 

1.0000 

1.0000 

1.0000; 



1.0000 

1.0000 

1 . 0000 

1 . 0000] ; 


X.in = [] ; 


E.5.3 Controller Design: HLdes.m 

To illustrate the working of the HLdes.m m-file for the H ^ control 
include below a listing of the file Examplel.m which contains a setup 
design variables and a call to HLdes.m. 
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Prnt,var = 30; 

[Co_out ,Gamma,ach ,X_out] = ... 

Hi_des (File.name , Gamma,Co_in ,P_L ,P_U, X,in,Prnt_var) 

7 . 

'/, End Examplel.m 

7 . 


The design goal is to synthesize a full-order (n c = 3) strictly proper controller 
that satisfies the specified T^oo-constraint Gamma = 2.3. As reported in [88], the 
minimally achievable Woo-norm for this plant is approximately 2.1426. For the fol- 
lowing sample run the following parameter values were chosen: NrJterJmpC = 4, 
Nv-improveO — 400, Nr^iter.impX =3, Nr-improvcX = 700 and Costas el = 1. Execu- 
tion of Examplel.m produces design results that are saved in a diary file. A partial 
listing of the results is given below. 


>>Examplel 

File_name = 

Examplel 

Global_var = 

Dimensions,! System,! 


System,! = 
-0.3908 

-0.4565 

1.2657 

-0.4275 

0.0488 

1.4453 

-1.0491 

-1.2077 

-0.4470 

0.3608 

-0.1288 

0.6744 

1.0324 

-0.9172 

0.3564 

-1.5567 

-1.9432 

-0.0914 

0 

0.5185 

0.9420 

0.0144 

0.1187 

1.3575 

0 


Dimensions,! = 

3 1 1 


n_p = 

1 

n,u = 

! 

n,y = 


1 
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Gamma = 
2.3 


Co_in = 


0 

1 

2 

3 

1 

0 

1 

0 

1 

0 

0 

1 

1 

1 

2 

3 

P.L = 




1.0e+09 

* 



0 

-1 

-1 

-1 

-1 

■1 

- 1 

-1 

-1 

•1 

-1 

-1 

-1 

•1 

-1 

-1 

P.U = 




1.0e+09 

* 



0 

1 

1 

1 

1 ' 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

X_in = 




□ 




Prnt.var = 





30 


Maximum real part of all A_cl eigenvalues : Lambda_max_Acl = 

Trying to find stabilizing controller satisfying 
sigma_max(D_cl) < Gamma for all plant conditions! 


f-COUNT 

FUNCTION 

MAX{g> 

STEP 

Procedures 

1 

27.115 

0 

1 


2 

1.6919 

0 

1 


3 

0.0337288 

0 

1 


18 8. 

. 73314e-24 

0 

1 

mod Hess 


Intermediate Optimization Terminated Successfully 


5.42 


f-COUNT FUNCTION 


MAX{g> 


STEP Procedures 
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1 9.47196e-15 0 

2 0 0 

3 0 0 

Intermediate Optimization Terminated 


1 

1 mod Hess 

1 mod Hess 

Successfully 


The controller is stabilizing all plant conditions 
and satisfies sigma.max(D.cli) < gamma. i ! 
for all plant conditions. 

Continuing to improvement phase/main iteration loop 

No initial guess for X.in is given! 

OR: 

Some of the ARI eigenvalues are extremely large 

Trying to find better initial guesses for the main iteration 

- or as initial guesses for a restart of this program 


Starting the improvement phase: 
Optimizing on Co only: 

Updating Tf-values, please wait 


f -COUNT 

FUNCTION 

MAX{g> 

STEP Procedures 

1 

8.23622 

0 

1 

2 

6.00063 

0 

1 

3 

6.00063 

0 

1 


Intermediate Optimization Terminated Successfully 


Updating Tf-values, please wait 


f -COUNT 

FUNCTION 

MAX{g> 

STEP 

Procedures 

1 

41.0173 

0 

1 


2 

6.00477 

0 

1 


3 

6.00477 

0 

1 

mod Hess 

17 

6.00046 

0 

1 

mod Hess 


Insufficient cost function decrease 



Updating Tf-values, please wait 


f-COUNT 

FUNCTION 

MAX{g> 

STEP 

Procedures 

1 

1101.63 

0 

1 


14 

858.956 

0 

0 . 000244 


27 

109.521 

0 

0 . 000244 


399 

6.02436 

0 

1 

mod Hess 


Maximum number of iterations exceeded 


Updating Tf-values, please wait 


f-COUNT 

FUNCTION 

MAX{g> 

STEP 

Procedures 

1 

1101.55 

0 

1 


31 

1101.55 

0 

1 . 86e-09 


55 

1101.25 

0 

1 . 19e-07 


385 

424.405 

0 

0.125 

mod Hess (2) 


Intermediate Optimization Terminated Successfully 


Number of improvement steps on Co exceeded, 
continuing with optimization on X only: 


Updating Tf-values, please wait 


f-COUNT 

FUNCTION 

MAX{g> 

STEP 

Procedures 

1 

48.1392 

0 

1 


12 

44.2766 

0 

0.000977 


25 

42.7976 

0 

0.000244 


643 

5.09314 

0 

1 

mod Hess 


Insufficient cost function decrease 


Updating Tf-values, please wait 


f-COUNT FUNCTION 


MAX{g> 


STEP 


Procedures 
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1 

426.689 

0 

1 


20 

426.098 

0 

3 . 81e-06 


36 

413.426 

0 

3 . 05e-05 


423 

5.53867 

0 

1 

mod Hess 


Insufficient cost function decrease 


Updating Tf-values, please wait 


f-COUNT FUNCTION MAX{g> STEP 

1 59.9748 0 1 

26 59.9744 0 5.96e-08 

49 59.9559 0 2.38e-07 

699 34.7229 0 1 

Maximum number of iterations exceeded 


Procedures 


End of improvement phase, 

Continuing with main iteration loop 

Updating Tf-values, please wait 


Starting Iteration 1 with (minimal) Tf = 87.4 

Maximum real part of all ARI eigenvalues : Lambda_max_ARI = 0.0366 

Maximum real part of all A_cl eigenvalues: Lambda_max_Acl = -0.787 

Achieved inf -norms for all plants: 

System 1 : 2.86993 

f-COUNT FUNCTION MAX{g> STEP Procedures 

1 35.6239 0 1 

30 35.6238 0 3.73e-09 

56 35.6223 0 2.98e-08 

886 2.93837 0 1.49e-08 

Intermediate Optimization Terminated Successfully 
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All Hi-constraints satisfied 


Co_out = 

1.0e+02 * 

0 

-5.61830215774721 

-2.49550980375480 

-5.38689628028888 

Gamma. ach = 

2.23701497229569 

X.out = 


0.00267772193123 

-0.52007701815391 

-0.60157220605899 

-0.72850304408728 


0.00091843489067 

-0.03497247440197 

-0.43420296505282 

-0.29185379848967 


-0.67301817161558 


0.70696049742409 


-0.08565256194329 


-0.14769868862166 


0.03311347764003 


0.00144300504148 

-0.40920200207161 

0.60648866763827 

0.09084576068794 


-0.19397056072923 


-0.15953506186834 


0.40848499439910 


0.04001880566657 


-0.05313227809173 


1.0e+03 * 

Columns 1 through 4 
1 . 15630229860465 0 . 09249883566253 

Columns 5 through 8 

-0 . 17205624462823 0 . 28165410889259 

Columns 9 through 12 
0 . 05674695169626 0 . 05866233452346 

Columns 13 through 16 
0 . 10204208348404 0 . 08925625378226 

Columns 17 through 20 
0 . 03635819909302 -0 . 05844568069746 


Column 21 
0.08537398653844 


As it can be seen, the algorithm converges to a controller that satisfies the specified 
/ Hoo“bound. After the improvement phase, only one main iteration was necessary to 
satisfy the design goal. This fact further illustrates the importance of good initial 
guesses for the controller Co{ n and for the matrices X* . If no such good initial guesses 
were available, then appropriate starting values will be determined in the preliminary 
optimization phase. The improvement phase resulted in a maximum ARI-eigenvalue 
of 0.0366. During the subsequent main iterations the Ti^-novm was reduced from 
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Gamnidack = 2.86993 to Gamma a c / t = 2.23701. 

E.5.4 Example 2: Non-Standard Plant 

The example considered does not have any particular physical meaning. However, it 
is a rather challenging problem since it violates all the system assumptions made in 
[24] and [113] hence rendering these approaches incapable to solve this problem. The 
open-loop system Soo,op is given as follows. 

— 1 

x 


This plant is detectable through y l (but unobservable) and stabilizable via 11 } (but 
uncontrollable). Furthermore, the problem is singular and certain subsystems have 
invariant zeros on the ju >- axis (please refer to [24] and [113]). The open-loop system 
is unstable and the controller for this example is a static output-feedback controller 
of the form u = Ky . It is easily verified that the controller will stabilize the plant for 
any K < —1. The 7-f (X) -norm of the closed-loop transfer function from to z ^ is 
given by 

IliUAVOlU = ]4 

The startup file Example2.m for this case is: 

7 . 

7, Example2.m file 

7, 

clear 

clear global 

File.name = , Exalnple2 , 
evaKC’load 9 File.name ’_hi’]) 

Global. var 

System. 1 

Dimensions. 1 

n_p 

n.u 

n_y 


= (0 1 ) X 1 

= ( 1 )-* 
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pause 

Gamma = le-4; 

Co_in = 0; 

P_L = -le5; 

P_U =0; 

X_in = [] ; 

Prnt.var = 30; 

[Co_out ,Gamma_ach,X_out] = ... 

Hi_des(File_name , Gamma, Co_in,P_L,P_U,X_in, Prnt.var) 

7. 

7, End Example2.m 

7. 

Here we start out with a destabilizing controller and allow K to vary within the 
bounds -10 5 < K < 0. To achieve the desired 'H 00 -bound of Gamma = 10 -4 the 
algorithm has to find a controller K < -10 4 . The following diary shows the execution 
of the file Example2.m. 

>> Example2 
File_name = 

Example2 


Global.var = 

Dimensions.! System.! 

System.l = 

-110 0 

0 111 

0 10 0 

-110 0 

Dimensions. 1 = 

2 11 

n.p = 

1 


n.u 


1 
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n-y = 

1 


Gamma - 

1 . 000000000000000e-04 

Co.in = 

0 


P_L = 

-100000 

P.U = 

0 

X_in = 

[] 

Prnt.var = 

30 


Maximum real part of all A_cl eigenvalues : Lambda_max_Acl = 1 

Trying to find stabilizing controller satisfying 
sigma_max(D_cl) < Gamma for all plant conditions! 


f-COUNT 

FUNCTION 

MAX{g> 

STEP Procedures 

1 

5.99999 

0 

1 

2 

0.999988 

0 

1 

3 

0.999988 

0 

1 


Intermediate Optimization Terminated Successfully 


The controller is stabilizing all plant conditions 
and satisfies sigma_max(D_cli) < gamma.i ! 
for all plant conditions. 

Continuing to improvement phase/main iteration loop 

No initial guess for X_in is given! 

OR: 

Some of the ARI eigenvalues are extremely large 

Trying to find better initial guesses for the main iteration 

- or as initial guesses for a restart of this program 



Starting the improvement phase: 
Optimizing on Co only: 


Updating Tf-values, please wait 


f-COUNT 

FUNCTION 

MAX{g> STEP 

Procedures 

1 

1098.81 

0 1 



2 

3.02448 

0 1 



3 

3 . 02448 

0 1 

mod 

Hess 

19 

3.00101 

0 1 

mod 

Hess 

Warning : 

QP problem is 

-ve semi-definite. 



20 

3.00033 

0 1 

mod 

Hess 

Warning: 

QP problem is 

-ve semi-definite. 



21 

2.99863 

0 1 

mod 

Hess 

22 

2.99863 

0 1 

mod 

Hess 


Intermediate Optimization Terminated Successfully 


All Hi-constraints satisfied, 
terminating Co-improvements; 

Attempting to find solutions X for the ARIs 


Number of improvement steps on Co exceeded, 
continuing with optimization on X only: 


Updating Tf-values, please wait 

STEP Procedures 
1 

0.0625 
0.5 

Hi-bounds satisfied 


f-COUNT 

FUNCTION 

MAX{g> 

1 

3.00775 

0 

6 

2.81566 

0 

8 

2.5653 

0 

Overall 

cost is smaller 

than 1 


All Hi-constraints have been satisfied after the improvement phase 



242 


Co_out = 

-1 . OOOOOOOOOOOOOOOe+05 


Ganuna_ach = 

1.0000000023701706-05 


X_out = 

0 . 17528500753256 0 . 00000102832300 0 . 00094205358802 


The algorithm found the desired controller already in the “improvement phase” of 
the algorithm. In the subsequent optimization the algorithm attempts to find a solu- 
tion X that satisfies the corresponding ARI-constraint. The Quadratic Programming 
sub-problem during the optimization became semi-definite as the controller gain A 
reached its specified limit P\j — —10°. 

This example shows that this algorithm can accomodate a much larger class of 
Hqo control problems and systems than the approaches in [24] and [113]. 

E.5.5 Example 3: Multiple Plant Case 

The last example is a simultaneous 'H 0 o _ design for a F— 15 aircraft at two operating 
conditions. This example has been investigated in [105]. The operating conditions 
represent a subsonic and a supersonic flight condition. Both models are of 4 -order 
and the controller to be designed is a proper l si -order controller. The corresponding 
startup file is in Examples. m and its listing is given below. 

7 . 

7, Example3.m file 

7. 

clear 

clear global 
Filename = ’Examples 1 
evalCL’load ’ File.name ’_hi’]) 

Global. var 
System.l 
System. 2 
Dimensions. 1 
Dimensions. 2 
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n -P 

n_u 

n -y 

pause 

Gamma = [0.11 0.15]; 


Co. in 

= [ i 

2 

3 

4 

l; 


i 

2 

3 

4 

0]; 

P.L 

= le9* [-1 

-1 

-1 

-1 

-l; 


-1 

-1 

■1 

-1 

-13 

P.U 

= le9* [ 1 

1 

1 

1 

l; 


1 

1 

1 

1 

l] 


X.in = [] ; 


Prnt.var = 6; 

[Co. out , Gamma. ach,X. out] = ... 

Hi.des (File.name , Gamma, Co. in ,P.L,P_U, X.in, Prnt.var) 

*/. 

X End Example3.m 

y. 


The first execution of Example3.m resulted in the following output results. 

>> Example3 

File. name = 

Example3 

Global. var = 

Dimensions.l System. 1 Dimensions_2 System.2 

System. 1 = 

Columns 1 through 8 


-0.0082 

-25.70 

0 

-32.17 

-6.80 

-0.55 

0 

0 

-0.0002 

-1.27 

►— k 

o 

o 

0 

t 

o 

i— 4. 

0 

-0.27 

20.99 

0.0007 

1.02 

-2.42 

0 

-14.06 

0 

0.99 

0 

0 

0 

(-*■ 

o 

o 

0 

0 

0 

0 

0 

1.0000 

0 

0 

0 

0 

0 

0 

0 

0 

1.00 

0 

0 

0 

0 

0 

0 
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0 0 1.00 

0 0 0 

0.0147 0 0 

0 0.01 0 

0 -0.16 0 


System_2 = 

Columns 1 through 8 


-0.01 -95.91 0 

-0.0001 -1.87 1.00 

0.0006 -3.61 -3.44 

0 0 1.00 

1.0000 0 0 

0 1.00 0 

0 0 1.00 

0 0 0 

0.0147 0 0 

0 0.01 0 

0 -0.16 0 

Dimensions.l = 

4 3 3 

Dimensions. 2 = 

4 3 3 


n_p = 

2 

n.u = 

1 

n-y = 

4 

Gamma = 

0.1000 0.1500 

Co. in - 
1 
1 

P.L = 


0 0 0 

1.00 0 0 

0 0 0 

0 0 0 

0 0 0 


-32.11 -25.40 -0.79 

0 - 0.22 0 

0 -53.42 0 

0 0 0 

0 0 0 

0 0 0 

0 0 0 

1.00 0 0 

0 0 0 

0 0 0 

0 0 0 


2 3 4 1 

2 3 4 0 


0 

0 

0 

0 

0 


0 

-0.39 

2.04 

0 

0 

0 

0 

0 

0 

0 

0 


0 

0 

0 

0 

0 


0 

0 

78.46 

0 

0 

0 

0 

0 

0 

0 

0 
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1.0e+09 * 
-1.0000 

-1.0000 

-1.0000 

-1.0000 

O 

o 

o 

o 

-1.0000 

-1.0000 

o 

o 

o 

0 

T— ♦ 

1 


-1.0000 

-1.0000 


1.0e+09 * 

1.0000 1.0000 1.0000 

1.0000 1.0000 1.0000 


1.0000 1.0000 

1.0000 1.0000 


X_in = 

[] 


Prnt.var = 
30 


Maximum real part of all A_cl eigenvalues : Lambda_max_Acl = 

Trying to find stabilizing controller satisfying 
sigma_max(D_cl) < Gamma for all plant conditions! 


f-C0UNT 

FUNCTION 

MAX{g> 

STEP Procedures 

1 

36.4748 

0 

1 

5 

1 . 1 18e-05 

0 

0.125 

6 

1. 118e-05 

0 

1 


Intermediate Optimization Terminated Successfully 


The controller is stabilizing all plant conditions 

No initial guess for X_in is given! 

OR: 

Some of the ARI eigenvalues are extremely large 

Trying to find better initial guesses for the main iteration 

- or as initial guesses for a restart of this program 

Starting the improvement phase: 

Optimizing on Co only: 


Updating Tf -values, please wait 


f-COUNT FUNCTION MAX{g> STEP Procedures 

1 1748.08 0 1 


4.38 
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18 

1654.85 

0 

1 . 53e-05 


35 

1062.08 

0 

1 . 53e-05 


222 

19.642 

0 

1 

mod Hess 


Intermediate Optimization Terminated Successfully 


Updating Tf-values, please wait 


f-COUNT 

FUNCTION 

MAX{g> 

STEP 

Procedures 

1 

472.433 

0 

1 


19 

470.111 

0 

7 . 63e-06 


38 

457.481 

0 

3 . 81e-06 


177 

356.439 

0 

1 

mod Hess 


Intermediate Optimization Terminated Successfully 


Updating Tf-values, please wait 


f-COUNT 

FUNCTION 

MAX{g> 

STEP 

Procedures 

1 

522.758 

0 

1 


23 

522.721 

0 

4 . 77e-07 


44 

522.161 

0 

9 . 54e-07 


164 

517.261 

0 

1 

mod Hess 


Intermediate Optimization Terminated Successfully 


Updating Tf-values, please wait 


f-COUNT 

FUNCTION 

MAX{g> 

STEP 

Procedures 

1 

545.121 

0 

1 


26 

545.098 

0 

5 . 96e-08 


51 

545.058 

0 

5 . 96e-08 


195 

544.987 

0 

1 

mod Hess 


Intermediate Optimization Terminated Successfully 


Number of improvement steps on Co exceeded 
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continuing with optimization on X only: 


Updating Tf -values, please wait 


f-COUNT 

FUNCTION 

MAX{g> 

STEP Procedures 

1 

30.0505 

0 

1 

14 

29.3947 

0 

0.000244 

29 

28.5179 

0 

6 . le-05 

474 

11.0803 

0 

1 


Intermediate Optimization Terminated Successfully 


Updating Tf-values, please wait 


f-COUNT 

FUNCTION 

MAX{g> 

STEP 

Procedures 

1 

37.9007 

0 

1 


28 

37.9006 

0 

1.49e-08 


62 

37.9004 

0 

1 . 16e-10 


499 

9.94873 

0 

1 

mod Hess 


Maximum number of iterations exceeded 

Updating Tf-values, please wait 

f-COUNT FUNCTION MAX{g> STEP Procedures 

1 17.7262 0 1 

25 17.7261 0 1 . 19e-07 

50 17.7257 0 5.96e-08 

499 15.1179 0 0.125 

Maximum number of iterations exceeded 

End of improvement phase. 

Continuing with main iteration loop 

Updating Tf-values, please wait 
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Starting Iteration 
Maximum real part of 
Maximum real part of 
Achieved H, inf-norms 


1 with (minimal) 
all ARI eigenvalues : 
all A_cl eigenvalues: 
for all plants: 

System 1 

System 2 


Tf = 750 

Lambda_max_ARI = 0.00267 
Lambda_max_Acl = -0.445 

0.178205 
0 . 248668 


f -COUNT 

FUNCTION 

MAX{g> 

STEP 

Procedures 

1 

16.5223 

0 

1 


26 

16.5222 

0 

5 . 96e-08 


54 

16.5222 

0 

7.45e-09 


898 

3.11972 

0 

0.5 

mod Hess 


Maximum number of iterations exceeded 


All Hi-constraints satisfied 


Co_out = 

1.0e+02 * 

Columns 1 through 4 

-0 . 12550105856800 0 . 89086997906138 0 . 35143782391798 1 . 35261095959955 

-0 . 33497386811212 2 .41299990656566 0 . 92063181212225 3 . 52022469854965 

Column 5 

0.07546321725795 

0.13073533249575 


Gamma_ach = 

0 . 05695666274842 0 . 12963242582712 


X_out = 


Columns 1 through 4 

0 . 00395899934532 -0 .01900536171326 -0 . 00194982498687 -0 .01609309367332 


Columns 5 through 8 

0.00750824600468 0 . 22372281620987 0 .01491783289404 0.00190207501306 
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Columns 9 through 
-0.01651842028388 

Columns 13 through 
0.28261543024549 


12 

0.00604400182495 

16 

-0.00788095393616 


0.02339670805051 

0.02817775033799 

-0.00643992932888 

0.03045749624873 

0.00083333222729 


0.00234704648193 


0.00098758201217 


0.00140348168097 


-0.00189741626634 


0.14515239198804 


Columns 17 through 20 

-0 . 007164320224 66 -0 . 00207342379310 

Columns 21 through 24 
0 . 10793274494332 0 . 01466806585088 

Columns 25 through 28 
0 . 00573040760352 0 . 02165813619593 


Columns 29 through 30 
0 . 02716374583356 0 . 02244058255040 


Once again the design goal has been reached after the first main iteration, em- 
phasizing once again the importance of good initial guesses. However, for the same 
multi-plant problem, when we choose a set of smaller bounds on Gamma — [0.1, 0.1 1] 
and start the design optimization with the same initial guesses as before, clearly a sat- 
isfactory convergence will take a slightly longer time. A log of the program execution 
is given below after the initial improvement phase. 


Starting Iteration 1 with (minimal) 
Maximum real part of all ARI eigenvalues : 

Maximum real part of all A_cl eigenvalues: 

Achieved H_inf -norms for all plants: 

System 1 

System 2 


Tf = 358 

Lambda_max_ARI = 0.00558 
Lambda_max_Acl = -0.419 

0.163487 

0.262504 


f-COUNT 

FUNCTION 

MAXfg} 

STEP 

Procedures 

1 

24.5368 

0 

1 


31 

24.5368 

0 

1 . 86e-09 


63 

24.5368 

0 

4 . 66e-10 


899 

3 . 90574 

0 

1 

mod Hess 


Maximum number of iterations exceeded 
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Updating Tf -values, please wait 


Starting Iteration 2 with (minimal) 
Maximum real part of all ARI eigenvalues : 
Maximum real part of all A_cl eigenvalues: 
Achieved H_inf-norms for all plants: 

System 1 

System 2 


Tf = 2.46e+03 
Lambda_max_ARI = 
Lambda_max_Acl = 

0.0798264 

0.209862 


f-COUNT FUNCTION 

1 3.99268 

20 3.99239 

43 3.99203 


MAX{g> 

0 

0 

0 


STEP 

1 

3 . 81e-06 
2 . 38e-07 


Procedures 


899 2.29454 0 

Maximum number of iterations exceeded 


0.5 


Updating Tf-values, please wait 


Starting Iteration 3 with (minimal) 
Maximum real part of all ARI eigenvalues : 
Maximum real part of all A_cl eigenvalues: 
Achieved H_inf -norms for all plants: 

System 1 

System 2 


Tf = 4.51e+03 
Lambda_max_ARI = 
Lambda_max_Acl = 

0.0603576 

0.136723 


f-COUNT 

FUNCTION 

MAX{g> 

STEP 

Procedures 

1 

2.25419 

0 

1 


22 

2.25415 

0 

9 . 54e-07 


45 

2.25396 

0 

2 . 38e-07 


899 

1.65992 

0 

1 

mod Hess 


Maximum number of iterations exceeded 


0.000266 

-0.429 


9 . 3e-05 
-0,445 


All Hi-constraints satisfied 
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Co.out = 

1.0e+02 * 

Columns 1 through 4 

-0 . 41791228209161 4 . 44752162549461 0 . 63314014709939 3 . 04060895422836 

-0 .46116010039480 4.96770681319143 0.72541231182832 3.46117417794747 

Column 5 

-0.08449083071726 

-0.13359059043192 


Gamma. ach = 

0 . 06582983596218 0 . 09846974908558 


X.out = 

Columns 1 through 4 

0 . 00954172281255 -0 . 10435603865224 -0 .01003061271832 -0 . 07181595360680 

Columns 5 through 8 

0 . 00536221146395 1 . 23228899877861 0 . 10661647033237 0 . 70055503142613 

Columns 9 through 12 

-0 . 06444161581800 0 .01525554772346 0 . 07260760853509 -0 . 00173347068189 

Columns 13 through 16 

0 . 79158344370358 -0 . 05645086683592 0 .01048230245748 0 . 00252476732077 

Columns 17 through 20 

-0 . 02787365098033 -0 . 00306582874682 -0 . 03204022536248 0 . 00648645844409 

Columns 21 through 24 

0 . 32418777048187 0 . 03260732184157 0 . 36598113312310 -0 . 08052795714074 

Columns 25 through 28 

0 . 00466389967999 0 . 02229485722969 -0 . 00059685472857 0 . 80777388969307 

Columns 29 through 30 
-0.24917380201575 0.08809115810297 


The specified Woo-bounds have been achieved after 3 main iterations. In [105] it 



was reported that the minimally achievable l~i oc —n orm for the first plant condition 
is approximately 0.056 and that for the second plant condition is 0.096. Hence, the 
specified Tfoo-bounds in the above problem are very close to the optimally achiev- 
able values. As a “rule of thumb” it is expected that the computation time for 
convergence will increase when the chosen Gamma-bounds are getting closer to the 
minimally achievable TYrxUorms and also when the problem size is large. Note also 
that the maximum eigenvalue of all the ARI’s should be a decreasing function of 
the iteration number, while the scaling factor “Tf” (the minimum over all scale fac- 
tors Vj^) is a monotonically increasing function. This constitutes the expected and 
desired behavior of the algorithm. Failure of convergence would generally be charac- 
terized by “stagnant Tf values”, and the maximum eigenvalue of all the ARI’s is a 
non-monotonically decreasing function of the iteration number. 



